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FOREWORD 
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1  INTRODUCTION 


The  concept  of  a  state  in  a  mathematical  formulation  of  a  physical  law  dates  back  to  Newtons 
Principia  —  where  the  first  comprehensive  formulation  of  some  aspects  of  natural  law  was  cast 
in  the  form  of  differential  equations.  The  Hamiltonian  formulation  of  mechanics  in  the  early 
19th  century  was  the  first  explicit  formulation  of  mechanics  that  coidd  be  regarded  as  a  state 
space  formulation  with  the  position  and  momentum  variables  forming  the  two  state  variables. 
State  space  could  not  be  said  to  be  fully  born  until  the  Cartesian  formulation  of  mechanics  in 
terms  of  symplectic  variables  in  the  30 ’s.  With  the  advent  of  the  mathematical  formulation  of 
quantum  mechanics  and  quantum  field  theory  during  the  last  sixty  years,  the  concept  of  state 
has  started  to  break  down  as  the  concept  of  a  distinctive  particle  has  begun  to  disappear  to  the 
point  where  many  physicists  are  inclined  to  think  the  particle  concept  has  outlived  its  usefidness. 
Without  the  concept  of  identity,  there  is  a  breakdown  of  distinctiveness  that  is  needed  to  achieve 
a  state-based  formulation  of  dynamics. 

The  picture  of  what  a  state  is  in  the  area  of  mathematical  engineering  is  considerably  better. 
Post  WWII,  mathematics  was  used  to  profit  in  the  fifties  and  sixties  to  formulate  a  modern 
mathematical  theory  of  systems  theory  (culminating  in  Zadeh’s  book  on  systems  theory  [19]), 
the  Kalman  solution  of  the  estimation  problem  (Kalman  filter),  the  formulation  of  optimization 
theory,  as  well  as  Bellman’s  development  of  dynamic  programming.  The  deeper  and  rigorous 
understanding  of  the  state  concept  has  made  all  of  this  progress  possible. 

As  engineering  extends  the  state  concept  into  new  areas  where  the  concept  of  state  has  not 
previously  been  applied  —  it  remains  the  task  of  mathematical  engineering  to  help  “clean  up  ” 
the  formulation  of  what  a  state  is  so  that  it  can  be  applied  to  wider  and  wider  domains.  In  this 
document,  we  take  some  concepts  that,  were  developed  jointly  by  the  author  and  W.L.  Root  to 
extend  state  concept  so  it  may  be  applied  to  new  problem  domains  where  new  state  concepts  are 
needed.  At  the  heart,  of  the  definition  of  what,  a  state  is,  there  is  an  ordinary  or  partial  differential 
equation  that,  is  used  to  formulate  an  explanation  of  the  behavior  of  a  physical  system,  and  the 
behavior  of  certain  physical  systems  suggests  new  approaches  to  the  state  concept.1 

State  is  of  fundamental  importance  in  systems  theory.  The  exact  description  of  state,  as 
can  be  seen  in  the  literature  (some  mentioned  below),  depends  on  the  system.  However,  state 
condenses  the  past  input  and  has  a  state  transition  property.  A  generic  and  general  definition 
of  state  is  given  by  Kalman,  Falb,  and  Arbib,  [6].  Natural  state  is  defined  for  input-output 
systems.  Natural  state2  was  defined  by  Root,  [10],  and  it  was  shown  that  it  inherits  certain 
continuity  properties  from  the  system.  Natural  state  conforms  to  the  Kalman-Falb- Arbib  state. 

We  discussed  the  natural  state  of  an  input-output  system  in  a  previous  paper,  Root  and 
Serakos,  [13],  and  examples  were  presented.  The  natural  state  is  a  mapping  from  future  inputs 
to  future  outputs.  The  natural  state  is  specified  by  the  of  past  state  and  past  input.  The 
relationship  of  the  natural  state  to  the  Nerode  equivalence  classes,  [7],  and  the  more  inclusive 
behavioral  approach  of  Willems,  [18],  is  discussed  in  [13].  The  natural  state  inherits  many 
properties  from  the  input-output  system.  Some  of  these  properties  are  discussed  in  [10]  and 
[13].  For  instance,  the  natural  state  is  continuous  (respectively  bounded)  if  the  input-output 


John  E.  Gray,  Electromagnetic  and  Sensor  Systems  Department,  NSWCDD. 
2 The  definition  of  natural  state  is  provided  in  this  report,  Definition  7. 
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system  is  continuous  (respectively  bounded.)  The  mapping  from  past  input  to  the  natural  state 
space  is  continuous  under  specified  conditions.  Conditions  for  the  continuity  of  the  natural  state 
trajectory  and  future  state,  based  on  past  state,  are  presented  in  [13].  Also  in  [13],  the  natural 
state  of  a  nonlinear  system,  given  by  an  integral  operator,  is  computed,  and  it  is  shown  that 
for  linear  time-invariant  systems,  the  natural  state  is  equivalent  to  the  traditional  state. 

In  this  report,  we  discuss  further  properties  of  the  natural  state.  Hence,  in  a  strong  sense  this 
report  is  a  continuation  of  [13].  There  are  two  areas  of  emphasis:  First,  we  define  the  natural 
state  space  as  the  set  of  all  natural  states  that  can  be  attained  by  an  input-output  system. 
Considering  a  family  of  input-output  systems  with  input  and  output  spaces  in  common,  a 
map  may  be  defined  from  this  family  to  their  natural  state  spaces.  Of  natural  mathematical 
interest  is  the  invertibility  of  this  natural  state  space  map.  For  typical  systems,  the  natural 
state  space  map  is  invertible;  hence,  it  may  be  a  desirable  property  to  extend  to  more  general 
systems.  In  this  light,  the  invertibility  of  this  map  may  be  important  in  ruling  out  undesirable 
or  unintended  properties  in  models  of  systems.  An  example  is  given  that  shows  the  natural 
state  space  map  need  not  be  invertible,  in  particular  when  the  system  has  “too  much  memory.” 
Essentially  the  same  example  shows  that  reachability  of  one  natural  state  from  another  can  be 
severely  curtailed  when  there  is  too  much  memory.  Finite  memory  or  fading  memory  has  been 
mentioned  in  connection  with  a  number  of  applications,  such  as  Kalman  filtering,  Anderson 
and  Moore,  [1],  systems  theory,  Root,  [9],  and  stability,  Serakos,  [15].  A  proposition  giving 
sufficient  conditions  for  the  invertibility  of  the  natural  state  space  map,  which  involves  memory 
length,  is  presented.  A  general  class  of  input-output  systems  represented  by  integral  operators 
are  considered  to  see  when  they  are  determined  from  their  natural  state  space.  A  proposition, 
also  involving  memory,  is  presented  that  gives  sufficient  conditions  for  reachability. 

The  second  area  has  to  do  with  natural  state  differentiability  properties.  The  properties  are 
patterned  after  the  continuity  properties  in  [13].  The  results  presented  are  differentiability  of 
the  natural  state,  differentiability  of  the  mapping  from  the  past  input  to  the  natural  state,  and 
differentiability  of  the  natural  state  trajectories.  These  results  are  inherited  from  appropriate 
differentiability  properties  of  the  input-output  system.  These  differentiability  properties  may 
be  contrasted  with  the  work  of  Jakubczyk,  [4],  [5],  and  several  of  his  references.  In  these  papers 
a  full  state  space  differential  equation  is  developed.  For  example,  this  is  in  contrast  to  the 
differentiability  of  individual  natural  state  trajectories  developed  here. 

The  results  presented  in  this  report  are  original  and  the  author’s,  except  as  stated  in  the 
foreword. 
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2  PRELIMINARIES 


The  purpose  of  this  chapter  is  to  present  the  reader  with  a  workable  definition  of  an  input- 
output  system  and  natural  state.  An  input-output  system  is  herein  denoted  (Y,  F,  U )  where  F 
is  a  mapping  from  an  input  space  U  to  an  output  space  Y .  and  where  U  and  Y  are  translation- 
invariant  spaces  of  vector- valued  time  functions.  The  vector  values  of  these  time  functions 
typically  are  $tN ,  N  =  1,  2,  •  •  • ,  but  only  need  to  be  Banach  spaces.  Other  spaces  and  mappings 
related  to  (Y.  F,  U )  will  be  introduced,  but  U  and  Y  with  whatever  affixes  they  carry  always 
refer  to  input  and  output  spaces.  Mappings  from  various  input  spaces  to  output  spaces  are 
denoted  either  F  or  £,  again  with  qualifying  affixes;  £  (or  lower  case  Greek)  is  reserved  for  state 
operators  (i.e.,  for  natural  states). 

The  input  and  output  space  metrics  are  set  up  by  seminorms  referred  to  as  fitted  families 
(FFs)  of  senrinornrs.  Roughly  speaking,  fitted  families  work  like  Lp  norms  on  time  functions 
with  the  additional  feature  that  a  time  weighting  can  be  incorporated  so  that  the  distant  past 
of  an  input  or  output  time  function  may  be  de-emphasized.  The  notation  ||?xS)t||  .  indicates  the 
norm  (e.g.,  weighted  Lp  norm)  of  the  input  u  over  the  interval  of  time  (s,t].  Usj  is  the  space 
of  inputs  over  the  same  interval.  FFs  were  initially  described  by  Root,  [9]. 

Definition  1  ([9])  Let.  C  =  £(3ft,  E)  be  a  linear  space  of  time  functions  from  5?  into  a  Ba¬ 
nach  space  E  such  that,  any  translate  of  a  function  in  C  is  also  a  function  in  C.  Let  M  = 
{||-||s  t ,  — oo  <  s  <  t  <  oo}  be  a  family  of  seminorms  on  C  satisfying  the  following  conditions: 

(1)  For  /i,/2  G  C,  if  /i(r)  =  /2(r)  for  s  <t  <t  then  ||/i  -  f2\\S)t  =  0. 

(2)  Let  Lr  denote  shift  to  the  left  by  t.  For  all  f  G  C,  ||LT/||S_T  t_T  =  ||/||st. 

(3)  Let  r  <  s  <t.  Then  for  all  f  6  C,  ||/||S)t  <  ||/||r  t. 

(4)  Let.  r  <  s  <  t.  Then  for  all  f  G  C,  j|/j|r>t  <  ||/||r>s  +  ||/||Sjt- 

(5)  There  exists  0  <  a  <  oo  and  K  >  1  such  that,  if  0  <  t  —  r  <  a  and  r  <  s  <  t,  then  for 

all  fe£,  \\f\\r,s<K\\f\\rtt. 

The  pair  (C,J\f)  is  called  a  FF  of  seminorms  on  C.  The  normed  linear  space  formed  from 
equivalence  classes  of  functions  in  L  with  norm  ||-||5t  is  denoted  AStt.  The  elements  of  AS}t  are 
the  equivalence  classes  determined  by:  f  g,  f,g  G  £  if  and  only  if  \\f  -  g\\s  t  =  0.  They  are 
denoted  uSjt,  ysj,  etc.  The  set  {As>t\,  —  oo  <  s  <  t  <  oo,  is  the  FF  of  normed  linear  spaces 
given  by 

A  fairly  wide  class  of  examples  of  FFs  are  given  by  weighted  Lp  spaces.  For  1  <  p  <  oo, 
let  to  be  a  fixed  nonnegative,  nonincreasing  Lebesgue  measurable  real-valued  function  and  let 
C  =  Sft^)  be  the  set  of  N  vector-valued  functions  on  3ft  that  are  p-integrable  Lebesgue  on 
finite  intervals.  Then,  for  f  €  C  the  senrinornrs 

ll/lla,t  =  (/  II f{r)\\pw(t- T)dr)1/p  (2-1) 

J  S 

satisfy  Conditions  (1),-  •  •  ,(5)  of  Definition  1.  For  p  =  oo,  let  C  be  the  set  of  essentially  bounded 
functions.  When  a  =  +oo  and  K  =  1,  a  uniform  time  weighting  is  given  and  (£,AA)  is  referred 
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to  as  a  standard  FF  of  seminorms.  As  time  weighting  was  not  essential  to  its  purpose,  standard 
FFs  were  used  in  [13]. 

We  define  another  FF  of  seminorms.  For  /  £  T,  put  \\f\\b'f  =  sups<T<t  ||/||s  T.  With  A4 
indicating  this  new  set  of  seminorms,  (T,  A4)  is  indeed  a  FF  of  seminorms,  [9]. 

A  FF  (T,  A f)  and  {AS)t},  — oo  <  s  <  t  <  oo,  can  be  augmented  to  include  H-H.^  t  by  taking 
the  limit  s  — >  — oo,  since  by  (3)  of  Definition  1  ||/||  .  is  monotone  nondecreasing  as  s  — >  — oo 
with  t  fixed.  Let  To  =  {/  £  £\  lim^-oo  ||/||s  t  <  oo,  t  £  R}.  For  /  £  To,  define 

ll/ll,  “J™,  ll/ll., ,  =  ll/ll-oo.,-  (2-2) 

With  the  meaning  of  (£,A f)  thus  extended,  ||-||st  is  defined  for  — oo  <  s  <  t  <  oo.  The  left- 
expanded  FF  of  seminorms  is  thereby  defined  and  is  denoted  (To ,Af).  It  still  satisfies  all  the 
Conditions  (1),  •  •  •  ,  (5). 

To  discuss  natural  state  we  also  need  to  define  ||-||500  and  24SiOC  in  a  meaningful  way.  For 
a  FF,  this  is  done  by  taking  the  supremum.  Let  Too  =  {/  €  To|  supt  ||/||t  <  oo}.  For  /  £  Too 
define 

ll/IUoo  =  SUP  \\f\\s,t  ;  -°o  <  s  •  (2-3) 

t>s 

It  may  be  readily  verified  that  if  (T,  J\T)  is  a  FF  for  indices  satisfying  — oo  <  s  <  t  <  oo  then,  with 
definitions  given  by  (2-2)  and  (2-3),  (Too, AO  is  a  FF  for  indices  satisfying  — oo  <  s  <  t  <  oo 
and  satisfies  Conditions  1,  2,  3,  and  5  of  Definition  1  for  indices  — oo  <  s  <  t  <  oo.  (For 
standard  FFs  Condition  4  holds  for  both  cases.)  {(Too,  Af),  ||-||s  t ,  — oo  <  s  <  t  <  oo}  is  called 
the  expanded  family  of  seminorms  determined  by  (£,Af).  Note  that  (Too,A4)  similarly  defined 
is  a  FF  for  — oo  <  s  <  t  <  oo. 

For  /  e  Too  we  put 

11/11=  sup  ll/ll,  =  ll/ll-oo, oo-  (2-4) 

tel R 

The  normed  linear  space  consisting  of  equivalence  classes  of  functions  in  Too  with  the  norm 
(2-4)  is  called  the  bounding  space  A  for  the  family  {ASjt}. 

The  extended  space  Ae  for  the  family  {AS)t}  is  the  set  of  all  equivalence  classes  of  functions  / 
in  T0  (/  g  iff  ||/  —  <7||  =  0)  for  which  ||/||s  <  oo  for  all  s.  It  does  not  have  a  norm  and,  indeed, 
is  given  no  topology.  This  definition  agrees  with  the  notion  of  extended  space  commonly  used 
in  the  control  literature. 

It  is  possible  that  a  FF  (T,A f)  has  a  vacuous  expansion  in  the  sense  that  Too  is  the  empty 
set.  An  obvious  example  of  this  is  given  when  T  is  the  set  of  all  constant  real-valued  functions 
on  SR  and  Af  is  the  set  of  Li-norms  on  finite  intervals.  To  prevent  this  from  happening  and 
further  to  prevent  the  bounding  space  A  from  being  too  small  (in  a  sense  to  be  made  explicit 
below)  we  can  require  that  a  FF  be  “full,”  as  in  the  following  definition. 

Definition  2  The  FF  (£,Af)  is  full  if  each  equivalence  class  uS:t  £  ASit,  —  oo  <  s  <  t  <  oo, 
has  a  representing  function  belonging  to  Too- 

When  this  definition  is  satisfied,  then  for  all  pairs  ( s,t ),  — oo  <  s  <  t  <  oo,  there  is  a  1:1 
correspondence  between  the  normed  linear  space  As ^  determined  by  (T,A f)  and  the  normed 
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linear  space  A'st  determined  by  (Too,  AO,  which  preserves  the  norrned  linear  space  structure. 
The  correspondence  is  given  by  us^  u's  t ,  uS:t  G  ASjt,  u'st  G  A!st  if  and  only  if  uS)t  and  v!st 
have  a  common  representing  function  /  G  Too-  Thus,  if  (T,AT)  is  full,  we  need  not  distinguish 
between  As  $  and  A/s  t .  Henceforth,  every  FF  mentioned  is  assumed  to  be  full.  The  FFs  formed 
with  Lp  spaces  as  described  above  are  full.  To  emphasize  the  relations  among  the  equivalence 
classes,  suppose  the  function  /  G  Too  determines  the  equivalence  classes  u  G  A,  vf  G  At,  ut  G  At 
and  uS)t  G  As>t.  Since 

11/  -  g\\Sit  <  11/  -  g\\t  <  11/  -  g\t  <  11/  -  g\\ 


the  equivalence  class  u  considered  as  a  set  of  functions  is  entirely  contained  in  the  equivalence 
class  vf  considered  as  a  set  of  functions,  and  similarly  vf  C  ut  and  ut  C  uS)t\  also  u  C  ut,0° .  Thus, 
e.g.,  given  t.  u  determines  ut  and  ut,0°.  Therefore,  if  /  determines  u  and  — oo  <  s  <  t  <  oo,  it  is 
meaningful  for  example  to  write  ||/||st,  ||it||sf,  ||fT||  ,  ||«s,0O||st,  ||«t||st,  ||uSjt||st,  and  they  are 

all  equal.  Let  — oo  <  r  <  s  <  t  <  oo.  Then,  since  ||/||st  <  ||/||rt  for  /  G  Too;  the  partitioning 
of  Too  into  equivalence  classes  by  ||-||rt  results  in  a  finer  partition  than  that  given  by  ||-||sf. 
That  is,  letting  /  determine  u  £  U,  we  have  u  C  urj  C  us 

In  order  to  define  the  natural  state,  it  is  necessary  to  consider  an  arbitrary  past  input 
concatenated  with  an  arbitrary  future  input;  that  is,  to  “splice”  two  inputs. 


Definition  3  For  —  oo  <  r  <  s  <  t  <  oo,  and  h,  g  G  T,  the  splice  of  h  and  g  over  (r,  t]  at  s  is 
defined  and  equals  f  if 


_  /  ^(T)>  r  <  t  <  s 
I  g(r),  s  <t  <t 

belongs  to  T.  It  is  denoted  frj  =  h,.yS+->  gSjt.  For  t  =  oo,  the  splice  of  h  and  g  equals  f  if 


f(T)  _  /  h(T),  r  <  t  <  s 

n)  U(r),  s<r 

belongs  to  T.  It  is  denoted  /r)0O  =  lir,s- (— >  gs>00- 

If  ur)S  G  AVtS,  vs>t  G  ASyt  are  determined  by  functions  h  and  g  respectively,  and  /ir,.sH — >  gs,t 
exists,  then  for  a  FF,  the  splice  of  u  and  v  (or  ur,s  and  vS:t)  over  (r,  t\  at  s  is  defined  to  be  the 
element  wr j  G  Arj  determined  by  hryS-\—>  gSjt]  we  write  wT)t  =  ur%s- vS)t ■  For  t  =  oo  we  write 
uv, oo  =  ur,s- 1-^  uS;00.  These  are  not  meaningful  until  it  is  proved  that  the  splice  is  independent 
of  the  particular  functions  h  and  g  representing  the  equivalence  classes  ur^s  and  vsj-  However, 
this  proof  follows  easily  from  Definition  1. 

Any  input  space  U  is  herein  taken  to  be  either  the  bounding  space  A  of  a  FF  {Asj}  that 
permits  splicing  or  a  translation-invariant  subset  of  A.  The  extended  space  Ae  can  appear  in 
an  auxiliary  role.  Whether  the  norrned  linear  space  A  is  complete  or  not  is  irrelevant  for  the 
purposes  of  this  report.  We  write  USit,  —oo  <  s  <  t  <  oo,  to  denote  the  set  (“space”)  of 
equivalence  classes  of  functions  belonging  to  U  as  determined  by  ||-||st.  If  U  =  A,  then  Us,t  is 
the  norrned  linear  space  As  $;  if  U  is  a  subset  of  A,  USjt  is  a  space  only  in  the  sense  that  it  is  a 
subset  of  AS}t.  We  call  any  US}t  a  truncated  input,  space  and  write  Ut  for  U-ocj- 

The  requirement  that  A  permits  splicing  means  that,  if  U  =  A,  future  inputs  at  any  t  can  be 
arbitrary,  independent  of  the  past.  Unfortunately,  spaces  of  functions  everywhere  continuous 
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on  3ft  do  not  qualify,  but  this  appears  to  be  a  minor  drawback.  It  is  sometimes  desired  that  U 
be  a  translation-invariant  bounded  (or  even  totally  bounded)  subset  of  A;  we  always  assume  U 
contains  the  zero  function.  If  U  is  a  proper  subset  of  A,  a  splice  of  two  elements  in  U  does  not 
necessarily  belong  to  U,  of  course.  However,  we  require  that  for  all  u  G  U,  both  utjr ->  0 ti0C  and 
04-|— >  ut>0 o  belong  to  U. 

The  output  space  Y  is  taken  to  be  the  bounding  space,  here  denoted  B,  of  a  FF  of  norrned 
linear  spaces  {Bsj},  or  occasionally  the  corresponding  extended  space  Be.  In  general,  the 
families  {Bst}  and  {AS;t}  need  not  be  the  same.  The  notations  for  output  spaces  are  analogous 
to  those  for  input  spaces.  The  comments  about  equivalence  classes  are  valid  for  the  yS)t  €  Bs f 
A  mapping  F  :  U  — >  Y  is  called  a  global  input-output,  mapping  (or  usually  just  input-output 
mapping) . 

Definition  4  Let  ( Y,F,U )  be  an  input-output,  system.  F  is  a  causal  mapping  and  ( Y,F,U )  is 
a  causal  system  if  and  only  if  for  all  t  and  for  all  u,v  6  U  such  that.  || u  —  u||t  =  0  it.  follows 
that.  H-F(u)  —  F(v)\\t  =  0. 

If  F  satisfies  this  definition  it  determines  a  mapping  from  Ut  into  Bt ,  denoted  Ff.  that 
satisfies  Ftut  —  ( Fu)t  =  0.  We  call  Ft  a  truncated  input.- output,  mapping  and  define  the 

centered  truncated  input-output,  mapping  Ft  :  JJq  — ■>  Yq  by  Ft{uo)  =  LtFfRt(uo),  where  Rf  =  L_t 
is  the  right-shift  by  t.  We  assume  that  all  systems  in  this  report  are  causal.  If  F  satisfies  this 
definition,  it  is  causal  in  the  usual  sense.  However,  memory  can  affect  causality. 

Definition  5  Consider  a  left- expanded  FF  {AS]t};  —  oo  <  s  <  t  <  oo.  The  family  {ASit}  and 
the  norms  ||-||t  are  said  to  be  finite  memory  with  memory  length  M  if  there  exists  0  <  M  <  oo 
such  that.  || f\\t  =  ||/||t_Mjt  for  all  f  G  L0,  t  G  3ft. 

Is  is  seen  that  if  w  in  (2-1)  has  finite  support,  that  is  w(t)  =  0  for  t  >  M,  the  weighted 
Lp  norrned  linear  spaces  are  examples  of  finite  memory  spaces  with  memory  length  M.  Finite 
memory  may  cause  a  system  that  is  causal  in  the  usual  sense  to  not  be  causal  according  to 
Definition  4. 

As  in  [13],  the  norms  we  use  here  for  input-output  mappings  F .  Ft,  and  Ft  and  for  the 
natural  states  are  the  A-power  norms,  denoted  [  •  ] (jv)  -  (We  omit  the  subscript  (A)  when 
possible).  Let  $  be  a  mapping  from  a  norrned  linear  space  X  into  a  norrned  linear  space  Z. 
For  any  nonnegative  integer  A,  the  A-power  norm  for  is  given  by 

l*lW  =  sup  JALL  (2-5) 

xex  1  +  ||x|| 

when  the  right  side  exists.  We  say  <I>  is  bounded  (in  N-power  norm)  if  |4>1(at)  <  oo.  If  4>  is 
bounded,  it  carries  bounded  sets  into  bounded  sets  by  the  inequality 

ll®WII<l*lw(i  + 11*11")  • 

However,  boundedness  of  does  not  in  general  imply  continuity  nor  vice  versa.  The  space  of 
bounded  operators  from  U  to  Y  is  denoted  by  Fn{U,  Y).  The  space  of  bounded  and  contin¬ 
uous  operators  from  U  to  Y  is  denoted  by  Cn(U,Y).  We  have  chosen  to  use  A-power  norms 
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rather  than  Lipschitz  norms  because  they  are  less  restrictive  and  because  they  are  not  so  much 
influenced  by  the  fine  structure  of  a  mapping.  This  last  property  seems  to  be  important  when 
one  is  dealing  with  an  approximate  system  representation  (see  Heitman,  [3]  page  785).  Other 
properties  of  these  norms  are  given  in  the  appendix  of  [13],  which  also  gives  comparisons  with 
the  Lipschitz  norm.  Although  [13]  uses  the  standard  FFs,  its  appendix  also  applies  to  FFs  in 
general.  The  JV-power  norms  are  special  cases  of  a  more  general  class  of  weighted  supremum 
norms  where  ||x||W  in  the  denominator  of  the  defining  expression  is  replaced  by  an  arbitrary, 
continuous,  positive  function  of  x;  X  need  not  be  norrned  (see  Appendix  A  in  [14]). 

Using  (2-5)  on  the  truncated  system  mapping  and  the  system  mapping,  we  have 


D^il(JV)  =  sup  =  sup 


Ft  ( ut ) 


uo  1  +  Uo 


and 


Ut  1  + 

|F|(w)=supiTnF 

u  1+M 


=  lFt\(N) 


Hence,  we  have  the  useful  relationship 


(2-6) 


(2-7) 


IF\(n)  <  sup ] Ft !(jv)  =  sup[Ft|(JV)  . 


(2-8) 


Throughout  this  report,  whenever  there  is  reference  to  a  system  ( Y,F,U ),  the  following 
three  hypotheses  are  in  effect  unless  specifically  noted  otherwise: 

(A)  The  input  space  U  is  either  the  bounding  space  A  of  a  FF  of  norrned  linear  spaces  that 
permits  splicing  or  a  shift-invariant  subset  of  such  an  A.  If  U  is  a  proper  subset  of  A, 
we  require  that  it  contain  0,  but  also  that  u  G  U  implies  both  utjt—>  0 tj00  and  0*-H>  ut>O0 
belong  to  U. 

(B)  The  output  space  Y  is  the  bounding  space  B  of  a  FF  of  norrned  linear  spaces. 

(C)  The  global  system  operator  F  satisfies  Definition  4  (causality)  with  respect  to  the  given 
A  and  B. 


The  noncentered  natural  states  and  the  natural  states  £“  are  to  be  defined  as  operators 
with  domains  77“  and  77“ ,  respectively,  where 

77“  =  {vttoc  €  Ut,oo  |u*4 — *  vt,oo  £  U,  Vu*  C  ut} 

and 

T7t  —  {uo,oo  ^  ^0,oo|u  H  *  ^  ^1,  Vu  CL  • 


Lemma  6  Under  the  conditions  just  specified,  given  any  t  £  SR  and  any  u  £  U,  there  exists  a 


mapping  £t  :  77“ 


4tj00  such  that 


{vt, oo)  -  (F(ut+^  vt,oo))t,oo  =  0  for  all  vt )00  e  77: 


t,  OO 


— 'LL  — %F  / 

Furthermore,  if  u  and  v!  satisfy  ||u  —  u'\\t  =  0  then  =  £t  ■  (Note  that  77“  =  Vf  .) 
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The  proof  of  Lemma  6  is  similar  to  the  proof  of  Lemma  1  in  [13].  Denote  the  Nerode 

equivalence  class  of  defining  inputs  for  by  [ut]^',  i.e. ,  u't  €  [tq^  if  =  £t .  Lemma  6  allows 
one  to  frame  the  following  definition. 

Definition  7  ([10],  [13],  [14])  The  natural  state  for  a  system  (Y.  F,  U)  induced  at  time  t  by 
input  ut  is  defined  to  be  the  operator  from  Vf  to  Yo,oo  given  by 

£t(v 0,oo)  =  L tfit  (Rwo,oo)  •  (2-9) 

The  set  of  natural  states  is  denoted  S;  the  set  of  natural  states  that,  can  be  achieved  at  time  t  is 
denoted  E(t)  so  that  E  =  UtesftS(i).  (5  is  referred  to  at  times  as  the  natural  state  space  or  the 
natural  state  set.) 

Obviously,  the  state  set  S  is  minimal  since  £  £  E  is  defined  as  a  mapping.  Natural  state 
may  be  defined  for  F  not  necessarily  causal;  however,  we  only  consider  causal  F  here. 

The  next  hypothesis  will  often  be  needed  but  will  not  be  in  effect  unless  stated  explicitly. 

(D)  The  operators  T)  :  Uq  — >  Yq  are  uniformly  bounded  in  iV-power  norm  for  some  fixed 
positive  integer  N  by  a  constant  C  <  oo  for  all  i  G  SR,  and  are  an  equicontinuous  family 
of  uniformly  continuous  mappings. 

Hypothesis  (D)  gives  that  the  global  system  operator  is  bounded  with  bound  C  and  uni¬ 
formly  continuous,  see  Lemmas  4  and  5  of  [13]. 3  Let  J-n(X,Z)  be  the  norrned  linear  space 
of  all  mappings  4*  :  X  — >  Z  with  |<h[Ar  <  oo,  and  Cn{X,Z)  be  the  norrned  linear  subspace 
of  Fn{X,Z)  of  all  continuous  4>.  With  Hypothesis  (D)  in  force,  E  C  Cn(Uoj00,  Lo,oo);  see  Ap¬ 
pendix  A.  Other  properties  that  result  from  Hypothesis  (D)  are  given  in  [13]  and  [14]  and  are 
mentioned  at  the  time  they  are  invoked.  As  stated  previously,  properties  of  the  natural  state 
and  its  relationship  to  F  are  given  in  [10],  [13],  and  [14]. 


3The  proofs  given  in  [13]  were  intended  for  a  standard  FF;  however,  such  proofs  usually  hold  for  FFs  in  general 
if  Condition  5  of  Definition  1  is  not  used. 
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3  SOME  STATE  SPACE  PROPERTIES 

There  are  a  few  properties  of  the  natural  state  space  that  can  be  related  to  constraints,  or 
lack  of  constraints,  on  memory  and  on  the  class  of  admissible  inputs.  We  have  seen  in  [13]  that 
the  system  determines  the  natural  state  space.  We  will  find  that  some  common  systems,  those 
represented  by  linear  finite  dimensional  time-invariant  differential  equations,  are  determined  by 
natural  state  space.  That  is,  for  these  systems,  the  map  from  system  to  natural  state  space 
is  one  to  one.  Hence,  the  property  that  natural  state  space  determines  the  system  may  be 
desirable  for  understanding  system  models  in  general.  We  examine  how  memory  affects  this 
property.  The  idea  is  that,  in  a  sense,  natural  state  defines  the  future  part  of  the  system. 
This,  along  with  a  tapered  memory  (a  form  of  approximate  finite  memory,  defined  below), 
may  specify  the  system.  We  give  sufficient  conditions,  including  tapered  input  spaces,  by  which 
systems  are  determined  by  natural  state  space.  We  also  provide  sufficient  conditions  for  systems 
represented  by  polynomial  integral  operators  to  have  this  same  property.  We  consider  the  effect 
memory  has  on  reachability  of  states  in  the  natural  state  space.  It  is  shown  that  systems  with 
finite  memory  input  spaces  or  tapered  input  spaces  exhibit  a  degree  of  reachability.  Most  of 
the  results  in  this  chapter  are  for  time-invariant  systems.  We  start  with  an  example,  which  is 
very  simple  even  though  it  is  pathological,  that  points  out  certain  negative  possibilities. 

Example  8  Let  the  basic  function  space  £(5R,  3?)  for  inputs  be  the  set  of  real-valued,  functions 
on  3?  that  are  bounded  and  piecewise  continuous  ( continuous  except  possibly  at  a  finite  number 
of  points  on  any  finite  interval  and  with  finite  left-  and  right-hand  limits  at  these  points).  The 
family  of  norms  is  given  by  ||/||st  =  sups<T<t|/(r)|,  /  £  £(3ft,  3?).  The  input  space  U  is  either 
the  bounding  space  A  for  this  family  or  a  shift, -invariant  subset  thereof.  Let  the  basic  function 
space  for  outputs  be  the  Lebesgue  space  La 0  of  real-valued  functions.  We  want  to  have  a  finite 
observation  interval  of  length  b  >  0  for  the  outputs,  so  the  family  of  norms  is  given  by 

Il/Ils,t=  esssup  |/(r)|,  /  £  Loo  • 

max(s,t— b)<r<t 

The  output  space  Y  is  the  bounding  space  for  this  family,  and  one  has  Yt 
T  £  (0,  oo),  be  fixed  and  h  be  a  real-valued  integrable  function  such  that  h(s) 
and  /Qr  |/t(r)|  dr  0. 

Let  u  =  lim t^~oou(t).  Define  a  system  mapping  F  by 

A  fS 

[E(u)](s)  =  /  h(s  —  r)u(T)dr  +  u,  —oo<s<oo.  (3-1) 

J  —  OO 

The  output  is  yt  £  Yt,  where  yfis )  =  [Ft(ut)](s),  t  —  b  <  s  <  t,  is  given  by  (3-1)  with  s  restricted 
as  indicated.  The  mapping  F  is  linear  and  time-invariant.  Put  I  =  \h{r)\dr.  Consider  the 

continuity  of  Fq  and  F: 

||  Fq(u)  —  Fq(u')  ||  „  =  esssup  /  h{s  —  t){u{t)  —  u' {r))dr  +  {u —  v!) 

—b<s< 0  J s—T 


=  Yt-b,t.  Let.  T, 
=  0  for  s^  [0,  T\, 


3-1 


NSWCDD/TR-08/3 


<  I-(||it  —  ^Hq)  +  \u  —  u'\  .  (3-2) 

Since  ||m  —  w'||0  <  e  implies  \u  —  v!\  <  e,  Fq  is  uniformly  continuous  and  |-£o|jv  <  oo  for  any 

N  >  1.  Also,  F  is  uniformly  continuous  and  has  finite  N-power  norm  for  any  N  >  1. 

The  state  given  by 

r  0  rs 

Ko(t’o,oo)](s)  =  /  h(s  -  T)u{r)dT  +  u  +  /  h(s  -  r)v(r)dr,  s  >  0  ,  (3-3) 

where  it  is  to  be  noted  that,  the  first  integral  vanishes  if  s  >  T .  Thus  for  s  >  T,  [^o(^o,oo)]('S) 
depends  on  u  only  through  u.  Note  that  [£q \n  <  oo  for  any  N  >  1  and  is  a  uniformly  continuous 
operator. 

We  consider  this  basic  example  now  from  two  different,  aspects.  The  concept,  of  reachability 
is  needed  in  what,  follows. 

Definition  9  In  a  time- invariant,  system,  the  natural  state  tf"  is  reachable  from  if  there  is 

an  input,  that,  will  drive  the  system  from  the  state  to  in  finite  time. 


We  continue  the  example. 

(a)  To  start,  with,  it.  is  immaterial  whether  U  =  A  or  whether  U  is  bounded.  Denote  by 
U 1  and  U2  the  sets  of  inputs  u  £  U  such  that,  u  =  1  and  u  =  2  respectively,  and  suppose  they 
are  not.  empty.  Let.  H1  be  the  set.  of  states  {£o},  u  £  Ul ,  and  E2  be  the  set  of  states  {£g  }> 
iv  G  U2.  First.,  one  may  observe  that.  H1  and  E2  are  disjoint,  sets,  and  indeed  are  actually  a 
positive  distance  apart..  In  fact.,  for  any  u  £  U1  and  w  6  U2, 


l£o  -£olk  =  SUP 


IIKS-tf](t*,oo)|| 


0,oo 


Vo,, 


I N 
1 0,oo 


> 


ii[a-aKoo)iiTiC 


i  +  iiu 


I  TV 
lo,oo 


(3-4) 


for  any  particular  choice  of  v o,oo-  Let.  v(s)  =  0  for  all  s.  Then,  by  (3-3),  for  this  particular  v, 


l£o  —  ^0  1 JV  >  II  [Co  ^0  ]  (^0,00 


lT,oo 


>  1  . 


Furthermore,  no  state  in  E2  is  reachable  from  any  state  in  H1  and  vice  versa.  Since  the  system 
is  time-invariant. ,  if  the  state  (q,  u  £  U1 ,  were  to  be  reachable  from  the  state  represented  by 
w  £  U 2 ,  there  woidd  have  to  be  s  <  0  and  x  £  U  such  that  \RsW ^  +_>a:s’0  =  But,  this 
cannot  be,  because  (Rsw)s- 1-^  xS}o  =  w,  no  matter  what,  s  and  x  may  be,  implies  (Rsw)s- 1-^  rcSio 
generates  a  state  in  E2  whereas  £  H1.  Since  S1  and  E2  are  a  positive  distance  apart,,  we 
cannot  even  approximate  starting  from  .  We  note  that,  it.  is  admissible  to  consider  a  system 
as  above  with  input,  space  u  £  U1  U  JJ2 ,  since  this  U  is  translation-invariant, . 

(b)  Consider  now  two  systems.  Two  systems  ( Y,Fl,U )  and  (Y,F2,U)  (having  the  same 
input,  and  output,  spaces)  are  identical  if  for  all  u  £  U  we  have  y 1  =  F 1('u)  =  y2  =  F2{u).  Let,  S 
denote  the  natural  state  set,  for  (Y,  Fl,U),  and  let,  H  denote  the  natural  state  set.  for  ( Y. ,  F2,U). 
These  two  systems  have  identical  natural  state  sets  if,  for  all  (  £  E,  there  exists  r]  £H  such  that. 
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for  all  vo,oc  £  Uo,oo  we  have  y qjOC  =  £(/uo,oc)  =  £/oj00  =  71  (v0,oo)  cmd  vice  versa.  We  set  their 
input  space  to  be  U  =  A.  We  denote  the  first  system  by  F 1  and  define  it  by  (3-1).  The  system 
mapping  for  the  second  system  is  given  by 

[F2(w)](s)  =  f  h(s  —  r)w{r)dT  +  2  •  w,  (3-5) 

Js-T 

— oo  <  s  <  oo,  w  £  U .  These  are  clearly  different  systems.  We  claim ,  however,  they  have  the 
same  set  of  natural  states.  Let  the  state  given  by  u  at  t  =  0  in  the  first  system  be  (q  and  the 
state  given  by  w  at  t  =  0  in  the  second  system  be  rff .  For  arbitrary  u,  we  find  w  such  that 

[£oK,oo)](s)  =  [i)J’(»o,oo  )](s)  (3-6) 

for  all  v  and  all  s  >  0.  From  the  formula  for  [£o(uo)0o)](s);  (3-3)  and  the  corresponding  formula 
for  [r/o  (^0,00 )](s),  we  see  that,  any  w  £  U,  such  that  (i)  w  =  0.5  •  u  and  (ii)  w(s)  =  u(s )  for 
—T  <  s  <  0  will  satisfy  (3-6).  The  same  sort  of  argument  applies  the  other  way  around,  so  the 
two  systems  have  the  same  set  of  natural  states. 

Example  8  indicates  some  system  behavior  that  can  occur  if  there  is  “too  much  memory,” 
meaning  the  present  output  depends  on  input  from  too  far  back  in  the  past.  Presumably  one 
does  not  expect  this  sort  of  condition  should  occur,  even  in  the  model  of  a  natural  system.  It 
does  not  happen  with  systems  represented  by  the  following  types  of  linear  differential  equations. 

Example  10  Consider  two  different  systems  x  =  Ax  +  Bu  and  x  =  Fx  +  Gu,  with  output 
equation  y  =  x  for  both,  where  AfiF  and  where  x(t)  £  Kn,  u(t)  £  9tm.  Let  ( A,B )  and  (F,  G) 
be  completely  controllable.  Then,  the  state  vector  x{t)  for  each  system  may  be  any  point  in  3in. 
Let  the  natural  state  set  for  x  =  Ax  +  Bu  be  5  and  for  x  =  Fx  +  Gu  be  H.  From  Example  2 
of  [13],  a  vector  x{t)  £  corresponds  to  a  natural  state  £t  £  5  and  a  natural  state  r]t  £  H. 
However,  (t  f  ry;  e.g.,  consider  the  state  transition  property  for  and  yt.  It  may  also  be  seen 
that  Efl H=®.  If  H  =H  however,  then  A  =  F  and  B  =  G.  This  also  points  out  the  difference 
between  the  state  vector  and  the  natural  state. 

Using  systems  with  tapered  input  spaces  is  a  technical  device  which  has  been  mentioned  that, 
in  some  measure,  at  least  prevents  there  being  too  much  memory.  It  is  used  as  a  hypothesis 
in  what  follows.  Part  (a)  of  Example  8  illustrates  how  reachability  and  even  approximate 
reachability  can  be  prevented  in  a  system  with  too  much  memory.  We  have  no  strong  results 
on  reachability,  but  there  are  some  facts  that  can  be  deduced  immediately  and  are  summarized 
in  the  following  remark  and  in  Proposition  15.  We  will  need  the  following  definition. 

Definition  11  ([14])  Let  £(3J,  E)  be  a  translation-invariant,  space  of  time  functions  from  K 
into  E  with  the  property  that,  for  each  f  £  C,  there  is  a  real  number  T  =  T(f)  such  that 
f(t)  =  0  for  all  t  <  T.  Then  C  is  called  a  shifted-zero  space. 

Shifted-zero  input  spaces  may  be  convenient  when  considering  unstable  systems  that  do  not 
“blow  up”  in  a  finite  time  or  man-made  systems  that  are  activated  at  some  finite  time.  For 
time-invariant  systems,  shifted-zero  input  spaces  are  equivalent  to  the  system  being  defined 


3-3 


NSWCDD/TR-08/3 


over  the  half  line.  The  following  lemma  gives  sufficient  conditions  for  the  natural  state  space 
S  to  be  connected.  Connectedness  is  a  weaker  property  than  reachability  for  a  natural  state 
space  because  reachability  implies  connectedness. 

Lemma  12  (Serakos,  [14],  Proposition  4-2.1.)  Consider  a  (possibly  time-varying)  input-output 
system  (Y,F,U).  Assume  that  the  state  trajectories  are  continuous  (e.g.,  use  Proposition  4  of 
[13]  or  Proposition  4-1.2  of  [14])  and  that  U  is  a  shifted-zero  space.  Then  E  is  arcwise  connected. 

Proof:  In  fact,  given  ff  and  f",  suppose  =  £“  and  f"  =  £*’.  Since  U  is  a  shifted-zero 
space,  there  is  some  r  <  s,t  such  that  ||u  —  v||r  =  0.  The  state  trajectory  starting  with  If] 
generated  by  ur  -\ — >  vrs  connects  tfif  and  .  It  then  follows  there  is  an  arc  running  from  f'  to 
and  thence  to  f".  The  states  are  arbitrary,  so  it  follows  that  E  is  arcwise  connected.  (Note 
we  are  not  saying  that  f  is  reachable  from  f  .)  □ 

Remark  13  In  a  time-invariant-  system  with  a  finite  memory  input  space,  it  is  obvious  that 
any  state  is  reachable  from  any  other  state,  and  the  time  required  to  reach  a  specified  state  is 
no  more  than  the  duration  of  the  memory. 

From  Remark  13,  one  would  expect  that  a  system  that  has  an  approximately  finite  memory 
input  space  —  e.g.,  a  system  with  a  tapered  input  space  —  would  exhibit  approximate  reacha¬ 
bility,  at  least  in  the  time-invariant  case.  But  first,  we  present  the  definition  of  a  tapered  input 
space. 

Definition  14  ([10])  Consider  a  left-expanded  FF  {A^};  —00  <  s  <  t  <  00.  For  any  c  >  0 

and  t,  let  G(c,t)  =  {/  €  £o>||/||T  <  c  for  a U  T  <  t}-  Then  {ASit}  and  the  norms  ||-||t  are 
said  to  be  tapered  if,  for  any  e  >  0,  c  >  0  and  f  £  S,  there  is  6  =  5(e,c,t )  >  0  such  that 
ll/llt  <  \\f\\ts,t  +  e  f°r  aU  f  G  G{c,t). 

Note  that  <5  does  not  in  fact  depend  on  t  and  also  that  ||/||s  <  ||/||s_5  s  +  e  for  any  s  <  t. 
When  w  in  (2-1)  is  integrable,  the  weighted  Lp  norrned  linear  spaces  are  examples  of  tapered 
FF  of  norrned  linear  spaces.  A  specific  class  of  tapered  spaces  are  finite  memory  spaces.  For 
the  next  proposition,  we  use  the  fact  that  Hypothesis  D  implies  that  the  natural  state  is  a 
uniformly  continuous  function  of  prior  input  (see  Proposition  3  of  [13]). 

Proposition  15  (Professor  Root  provided  this  proposition.)  Let  Hypothesis  D  hold.  Let  U  be 
the  bounding  space  and  the  associated  norms  be  tapered.  Then,  given  e  >  0  and  any  two  natural 
states  f1  and  f",  the  natural  state  may  be  driven  from  f'  to  approximate  f"  as  closely  as  desired. 
In  fact,  if  and  £]'  =  £q  ,  there  is  t  <  0  such  that 

Proof:  Since  for  any  t,  the  result  follows  immediately  from  the  definition 

of  a  tapered  family,  the  fact  U  is  the  bounding  space,  and  since  (see  [13]  and  [14])  the  natural 
state  is  a  uniformly  continuous  function  of  prior  input.  □ 

A  standard  feature  of  the  natural  state  space  is  that  it  is  determined  by  the  system.  It  is  of 
mathematical  interest  to  see  when  the  map  from  system  to  natural  state  space  is  one  to  one. 
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Example  8  shows  that  natural  state  space  is  insufficient  to  determine  the  system.  Example  10 
gives  a  common  example  when  it  does.  Hence,  it  may  also  be  of  practical  interest  (for  instance 
in  modeling  man-made  or  natural  systems)  to  resolve  this  same  issue.  Situations  where  natural 
state  space  determines  the  system  are  given  by  the  following  propositions  and  corollaries. 

Proposition  16  ([14],  Proposition  4-8.3.)  Consider  two  causal  systems  (Y,  Fl,TJ)  and 
(Y,F2,U).  Let  these  systems  be  time-invariant ,  continuous,  and  have  the  same  state  set  5. 
Then,  if  U  is  bounded  and  tapered,  they  are  identical  systems. 

Proof:  To  show  that  F 1  and  F2  are  identical,  it  is  necessary  to  prove  that  f?1(rt)  =  F2(u) 
for  all  u  £  U.  Denote  a  state  for  F1  by  £  and  a  state  for  F2  by  r].  Given  an  input  u  €  U  to  F 2 , 
consider  the  state  trajectory  t  — >  rff.  For  T  fixed,  there  exists  v  £  U,  such  that  (for  a 

time-invariant  system,  a  natural  state  may  be  achieved  at  any  time).  Then, 

llfr(*o,oo)  -  Vt(xo,oo)\\0,oo  =  0 
for  all  xo,oo  G  Domain(£y)  =  Domain(r/^),  in  particular, 

II£t(lt(«t,oo))  -  ?7t(Lt(«t,oo))||0jOO 

=  || F1(wt-H’  ut, oo )  -  F2(utF+  ut,oo)||TiOC  =  0  . 

For  t  =  T  —  1,  there  exists  w  £  U  such  that  ff-i  =  rlf-i  ■  Again 

||.F1(li;T_1-|-»  UT-l.oo)  -  F2(uT~ljr^  ut-i,oo)||t_1j00  =  0  . 

Therefore,  it  may  be  assumed  that  v  =  u;T_1-|— >  ut- i,oo-  It  now  may  be  seen  that  a  sequence 
of  inputs  vl  €  U,  i  =  1,  2,  •  •  •  may  be  constructed  such  that  ||ffi  —  u||T+i_i  ^  =  0  with 

\\F\v1)  —  F2(u)\\T+1_ioo  =  0.  Here,  vl  =  vT+- ->  ut, oo  and  v2  =  wT~ljr^  ut~ i,oo- 
Since  U  is  bounded  and  tapered,  given  e  >  0,  there  exists  6  =  S(e,T )  such  that 

|K  —  u\\T  <  ||u*  —  u||T_5  T  +  e 

for  all  i  =  1,  2,  •  •  •  (Definition  14).  Take  i  >  6  +  1,  then 

|K  —  u||T  <  0  +  e 

since  for  such  i, 

llV  —  uIIt-<5,T  —  llU  _  MIIt+1-i,T  —  ^  ' 

Thus  Hindoo  ||u*  —  u\\T  <  e.  But  e  is  arbitrary,  so  lim^oo  ||u*  —  u||r  =  0,  i.e. ,  vlT  — >  ut ■  Then, 

||E1(u)-E2(u)|L=  lim  \\F\u)  -  F2(u)\L_.t 

1  j^OO  1  J’1 

=  lim  F1(  lim  vl)  —  F2(u ) 

j— KX)  i—>oc 


=  lim  lim  ||E1(u*)  -  F2(u)\\T_ ,T  . 
T-j,T  i^° oi->oo"  1  J’1 
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But  for  fixed  j,  for  all  i  >  j  +  1 


\\F\vi)-F2(u)\\T_JT  =  0  ■ 

Hence,  for  all  j. 

lim  IlF1^*)  —  F2(u) |L  .T  =  0 

i—>  oo  1  J’1 

and  thus, 

lim  lim  —  F2[u) |L_.r  =  0  .  □ 

In  the  following  two  corollaries,  additional  conditions  are  used  to  apply  Proposition  16  to 
systems  with  unbounded  input  spaces  and  time- varying  systems. 

Corollary  17  For  an  input-output  system  (Y,F,U)  with  state  space  E  and  unbounded  input 
space  U ,  let 

Ec  =  €  E|  ||U||  <  C}  . 

Let  {Y,Fl,U)  have  state  space  5  and  (Y,F2,U)  have  state  space  H,  and  as  in  Proposition  16, 
be  time-invariant  continuous  systems  with  U  tapered  but  unbounded.  Then  the  two  systems  are 
identical  ifEc  =H°  for  all  C  <  oo. 

Proof:  Apply  Proposition  16  to  all  designated  u  €  U  with  C  =  ||«||.  □ 

A  statement  may  be  made  concerning  Proposition  16  and  time- varying  systems  if  one  degree 
of  freedom  is  removed  in  a  manner  similar  to  the  previous  corollary. 

Corollary  18  For  an  input-output,  system  ( Y,F,U )  with  state  space  E,  let, 

m  =  e  h}  . 

Let,  (Y.  F1,  U )  having  state  space  E  and  (Y,  F2,  U )  having  state  space  H  be  continuous  but  time- 
varying  systems.  Let,  the  input,  space  U  be  bounded  and  tapered.  Then  the  two  systems  are 
identical  if  Eft)  =  H(t)  for  all  t  £  K. 

Proof:  Trace  through  the  proof  of  Proposition  16  applying  the  new  hypothesis  where 
appropriate.  □ 

Next,  we  look  at  the  question,  does  state  determine  system  for  systems  represented  by 
polynomial  integral  operators?  These  are  an  important  class  of  systems  because  they  may  be 
used  to  approximate  classes  of  systems;  see  [8].  A  scalar  version  of  the  following  proposition  is 
in  [16].  We  provide  a  definition  of  a  polynomial  integral  operator. 

Definition  19  ([14])  By  a  time-invariant,  Nth  degree  causal,  polynomial  integral  operator  with 
M -dimensional  input  space  u  =  [rq,  •  •  •  ,  um\  £  U  with  norm  ||rt||s  t  =  max*  ||«j||s  t  and  ||rq||s  t  = 
suPs<r<t  \ui(T)\  an'd  F- dimensional  output,  space  with  norm  ||y||st  =  max*  ||yj||st  and  ||yj||st  = 
suPmax(s, t-b)<T<t  \yi(r)\ ’  b  >  0,  we  mean  a  mapping  of  the  form: 

N 

foMlW  =  £[*?(«)](«),  pe[i,2,-..,f>]  (3-7) 

71=1 
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where 


[Fp(u)](t)  = 


.  M 

E 

U )" '  ,2rc.  —  1 


pi,-  , 
Jp 


‘(<71,  '  •  •  ,CTn)nj1(t  -  <7l)  •  •  '  Uin(t  ~  (Tn)d(Tl,  •  •  ■  ,  cfoy 


The  above  sum  is  taken  over  all  combinations  without  repeating;  hence,  there  are  Mn  terms. 
Such  an  operator  is  unchanged  if  the  kernels  fp1’  ,ln ,  all  p  and  n  are  symmetrized.  The  sym¬ 
metrized  kernel  of  fp1’"'  ,  denoted  by  /p1’  is  defined  by 


fii, 
J  V 


'  I'ln 


(<7l, 


A  1 


,  On.  = 


n 


! 


fl 


M1)’ 

V 


^7r  (n) 


Gn 


(1), 


,  o. 


r(n)) 


( The  sum  is  taken  over  all  permutations  7 r,  total  n\  terms). 


Advantages  and  disadvantages  of  polynomial  integral  operators  are  discussed  in  Section  3 
of  Root,  [8].  It  turns  out  that  their  generality  is  cited  for  both  of  these  considerations.  Their 
generality  makes  them  useful  while,  at  the  same  time,  can  make  them  unwieldy  for  some 
applications. 


Proposition  20  Consider  an  input-output,  system  represented  by  a  polynomial  integral  opera¬ 
tor.  The  following  conditions  are  imposed  on  the  kernels  fp1’  ’ln : 

(a)  /p1’’"’*"(r i,  •  •  •  ,  rn)  is  continuous  on  lRn. 

(b)  fp1’  ’ln{r i,  •  •  •  , rn)  is  absolutely  integrable  on  1Rn. 

(c)  The  symmetrized  kernel  f  satisfies 

SUp  Jp1’"  •  •  •  ,Ti,Ti+ 1,---  ,  Tn) 

T  l,—  ,r* 

is  absolutely  integrable  as  a  function  of  r*+i,  •  •  •  ,  rn  /or  all  1  <  i  <  n,  for  all  1  <  n  <  N  and 
all  p  G  P. 

Denote  the  class  of  operators  given  by  (3-7)  with  kernels  fp1’ " ’ln  satisfying  (a),  (b),  and 
(c)  by  V(N)  and  denote  the  subclass  ofV(N)  with  symmetric  kernels  by  Vs  (N).  Under  these 
conditions, 

(i)  In  the  class  of  systems  ( Y,F,U )  with  U  and  Y  as  given  immediately  above  and  with 
F  e  Vs (IV),  the  natural  state  set  H  determines  the  kernels  /i,  •  •  •  ,  fiy- 

(ii)  In  the  class  of  systems  ( Y,F,U )  with  U  and  Y  as  in  (i)  and  F  6  V(N),  the  natural 
state  set  H  determines  the  system,  i.e.,  determines  F. 

Proof:  Given  in  Appendix  B. 

Consider  systems  ( Y,F,U )  with  F  £  V(N).  Since  each  u  £  U  is  bounded,  F(u)  £  Y  by 
condition  (b);  hence,  these  systems  are  well-defined.  The  assertion  (ii)  follows  directly  from  (i). 
In  fact,  if  two  systems  of  the  specified  class  have  the  same  state  set  E,  they  are  represented 
by  the  same  set  of  symmetrized  kernels;  hence,  the  (perhaps  unsymmetrized)  kernels  used  in 
their  description  produce  the  same  mapping.  Our  proof  of  assertion  (i)  goes  by  first  taking 
an  interval  around  a  point  where  the  two  kernels  are  assumed  to  be  different.  By  looking  at 
the  form  of  the  natural  state,  an  input  is  selected  to  show  that  in  fact  the  two  kernels  have 
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to  agree  at  that  point.  Initially,  scalar  IV-degree  kernels  are  considered.  Then  ./V-order  scalar 
polynomial  kernels  are  considered.  Finally,  vector  polynomial  kernels  are  considered. 

We  note  that  we  need  only  conditions  (a)  and  (b)  if  the  systems  are  homogeneous  integral 
operators,  but  we  need  (a),  (b),  and  (c)  for  the  general  polynomial  case.  Incidentally,  (i)  implies 
that  under  the  stated  conditions  for  any  F  E  V(N),  the  symmetrized  kernels  are  determined 
uniquely  —  a  fact  we  presume  known. 

The  justification  for  this  proposition  is  that  the  restriction  of  a  bounded  input  space  used 
in  Proposition  16  or  the  restrictions  on  the  state  spaces  used  in  Corollaries  17  or  18  are  not 
required  for  Proposition  20.  However,  the  conclusion  here  is  weaker  in  that  the  uniqueness 
of  the  system  mapping  is  shown  to  hold  only  within  the  special  class  of  systems  defined  by 
polynomial  integral  operators. 
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4  STATE  DIFFERENTIABILITY  PROPERTIES 
IN  INPUT-OUTPUT  SYSTEMS 


In  this  chapter,  differentiability  properties  of  various  maps  involving  the  natural  state  of  an 
input-output  system  are  analyzed.  The  analysis  is  patterned  after  the  continuity  analysis  in 
Section  3  of  [13]  with  the  objective  of  obtaining  differentiability  analogs  to  some  of  the  continuity 
results.  In  this  regard,  these  results  may  be  viewed  as  upgrades  of  results  presented  in  [13]. 
These  results  are  inherited  from  appropriate  differentiability  assumptions  on  the  input-output 
system.  Gateaux,  as  well  as  Frechet,  differentials  and  derivatives  are  used  in  these  results  as 
they  appear  in  [14].  Here  we  present  the  Frechet  case  only.  Time- varying  systems  are  considered 
in  this  chapter. 

We  present  three  results.  All  require  the  differentiability  of  the  input-output  system.  The 
first  gives  the  differentiability  of  the  natural  state.  The  second  gives  the  differentiability  of  the 
map  from  past  input  to  natural  state.  This  result  requires  the  Frechet  derivative  remainder 
converges  uniformly  to  zero.  The  last  result  implies  the  differentiability  of  the  natural  state 
trajectories.  This  result  requires  that  U  be  shift  differentiable  and  that  t  — >  Ft  be  a  shift 
differentiable  system  trajectory. 

This  chapter  may  be  contrasted  with  the  work  of  Jakubczyk  [4],  [5],  and  also  with  Sussmann, 
[17].  In  comparing  [4],  [5],  and  [17]  with  this  report,  we  must  note  the  distinction  between  state 
vectors  and  natural  states.  Example  2  of  [13]  and  Example  10  (this  report)  aid  in  noting  the 
distinction.  In  [4],  [5],  and  [17]  state  vectors  are  considered,  while  in  this  report  natural  states 
are  considered.  In  [4]  and  [5] ,  a  finite  dimensional  state  space  differential  equation  realization  of 
an  input-output  system  is  developed.  This  is  in  contrast  to  the  differentiability  results  for  the 
natural  states  developed  here,  which  includes  differentiability  of  the  natural  state  trajectories. 
The  assumptions  used  in  [4]  and  [5]  are  necessary  and  sufficient  for  providing  a  finite  dimensional 
state  variable  realization  of  an  input-output  system.  A  fundamental  feature  of  these  papers  is 
that  the  state  vectors  are  points  in  an  ?r-dimensional  differentiable  manifold.  The  differential 
equation  representation  derived  in  these  papers  is  of  minimum  dimension  for  a  given  input- 
output  system.  That  is,  the  state  vectors  are  of  minimum  dimension  (or  n  is  minimized).  In 
[17]  a  differential  equation  representation  of  minimal  dimension  is  determined  for  a  system  that 
is  already  in  state  variable  or  differential  form  but  not  necessarily  minimal.  The  natural  state 
space  in  this  report  is  a  subset  of  an  infinite  dimensional  Banach  space  (e.g.,  it  is  not  necessarily 
linear,  locally  Euclidean,  or  a  manifold.)  As  mentioned  in  the  introduction,  the  natural  state 
space  has  the  essential  state  properties.  The  natural  state  space  is  minimal  as  set.  This  is 
different  than  minimizing  the  dimension  of  the  state  vector.  Also,  a  state  vector  in  [4]  and  [5]  is 
contained  in  an  open  set;  however,  a  natural  state  may  not  be  contained  in  an  open  set  (although 
Remark  13  gives  conditions  when  the  natural  state  space  is  connected).  No  coordinate  chart 
can  be  defined  on  the  natural  state  space  since  its  dimension  is  not  specified.  Dimensionality 
(finite  or  not)  is  not  relevant  in  this  report.  Differentiability  of  individual  natural  state  space 
trajectories  is  considered.  Because  of  these  reasons,  [4],  [5],  and  [17]  are  not  comparable  with 
this  report. 

In  this  chapter  we  will  assume  that  the  domains  of  the  states  are  large  enough  for  the  stated 
operations  to  be  defined  (e.g.,  U  =  A,  see  Hypothesis  A). 
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Definition  21  The  input-output,  system  (Y,F,U)  has  a  Frechet.  derivative  if  for  u,v  E  U,  with 
u  contained  in  an  open  subset  of  U , 

F(u  +  v)  =  F(u)  +  L(u,v)  +  W(u,v)  (4-1) 

where  L(u,  •)  :  U  —*■  Y  is  linear  and  bounded  and  W(u,-):U—*  Y  has  the  property  that 

urn  = 

1 1 1;  1 1  — >  o  ||u|| 

L(u,  v )  is  called  the  Frechet  differential  of  (Y.  F,  U)  at  u  in  the  direction  v,  and  W (■ u ,  v)  is  called 
the  remainder.  The  operator  L(u,  •)  :  U  — >  Y  is  called  the  Frechet  derivative  of  F  at  u  and  is 
denoted  F'(u),  [2j. 

We  make  a  special  note  that  Frechet  differentiability  implies  continuity,  see  Cheney,  [2]. 
The  following  proposition  is  a  differentiability  upgrade  to  Proposition  1  in  [13]. 

Proposition  22  If  the  Frechet  derivative  of  (Y,  F,  U )  at  u  exists,  then  the  Frechet  derivative 
of  the  natural  state  map  ff  :  Uo>00  — >  Yo,oo  °d  RtUt,oo  exists. 

Proof:  Let  uo,oo  =  Ltutioo,  wo,oo  G  U0>oo.  We  have 


ft  (^0,00  +  ^0,oo)  ft  iv0,oo) 

=  [L tF{utjr^  R t(vo  ,00  ^0,oo))]o,oo  [I JtF(u  H  >  Rt^0,oo)]o,oo 

—  [L tF(ut-\ — »  RtvO'Oo  >  Rt^ 0,00)  —  L tF(ut-\ — »  R^o  ,00  )]o,oo 

=  \TtL(vf -\ — >  Rt^o,oo)  0*H — >  Rtico,oo)  +  L tW (vf  — >  Rtuo,oo>  0*-| — >  Rt?co,oo)]o,oo 

=  [LtL(nf-| — >  Rtyo,oo,0*-H-  Rtwo,oo)]o,oo  +  [LttF(t^-| — ■>  Rt  1*0,00  >0*4 — >  RfW*o,oo)]o,oo  •  (4-2) 

Obviously,  L1(ti0j 00,  ■)  =  [LtL(td+- ->  RfU0,oo>  0*4-+  Rr)]o,oo  :  U0jOO  — ►  lb, 00  inherits  linearity  from 
L  ( u ,  •).  Also, 

.  j|-C'1(uo,oo,'^o!oo)||0oo  \\LtL(ut-H’  Rwo,oo,0*4-+  Rtw0,oo)||0oo 

0  L  []  =  sup  - 77 - 77 - —  =  sup  - 77 - 77 - — 

Wo, 00  ll^0,oo  llo, 00  wo, 00  11^0,00  llo, 00 


=  sup 

Rio,  00 


LtL(u*-h^  Rtvo,oo>  0*+- >  Rtw;o,oo)  O  oo  0*H-^  R^rco,oo) 


1 1 0*4-+  R^0loo)|| 

|Lf  L(utjr+  Rm  ,00  ?  0*4  >  R twot< 


<  sup 

R^0,oo 


Ry«’o,o 


11^0,00  1 1 0)OO 
<  0^0 ; 


hence,  L 1  is  bounded.  Defining  W1(v0,oo,w0,oo)  =  [LtW(ut+^  RtUo,oo>  0*4-+  Rtw0,oo)]o,oo>  we 
have 


lim 

1 1^0, 00 1 1 0,00 


W\v  0  ,00 1  ^0,oo  )  1 1 


0,oo 


Wwo,  c 


lO.oo 


lim 

llu’0,oo||0,oo— *0 


L ifF('U*4-+  Rtv0  ,005  0*4-+  Rf  1^0,00)  | 


0,oo 


\\w0,c 


1 0,oo 
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< 


lim 

Q*-l-»Rtt«o,o 


W{utjr^  Rtfo,oo,0*H-^  RtW0,co)| 


=  0  . 


+o  ||Ofo  *  R't^o,oo|| 

This  last  inequality  comes  from  the  change  in  the  time  interval  of  the  norm  in  the  numerator. 
Hence,  the  Frechet  derivative  of  £“  at  L tUt,oo  exists  with  Frechet  derivative  L 1  and  remainder 
W1.  As  a  final  point,  it  appears  that  L1  as  it  is  defined  above  depends  on  ut.  We  shall  show 
that  any  element  in  the  Nerode  equivalence  class  of  i.e. ,  any  ut  G  [ut]^  may  be  used.  Let 
ut,u't  G  [ut\£.  Then 


l^(Koo,  •)  -  Ln(v0,oo,  •)!  =  sup 

^0,oo 


L 


(^0,OO5  ^0,oo)  L  ('Uo  ,oo ?  ^0,oo)  1 1 q  c 

"^0,00  II  0,00 

it  i  ,  p  n t 


=  sup 

^0,oo 


[L tL(u  H — »  Htv 0,005  0  +- ►  Rt^o,oo)]o,oo  —  [L tL(v!  +- >  0,005  0  H— >  R^o,oo)]o 


I  O.00 


=  sup  lim 


c^O 


||Wo,oo  1 1 0,00 

[L tL(utjr->  R<u0ioo,  0*4-+  c  •  RfW0,oo)]o, 
- [LtL(un+- -+  Rtvo)oo,Ot+-*’  c  •  Rtw0,oo)]o 
c  •  II  Wo, 00  " 


OO 

OO 


O.00 


=  sup  lim 


«J0,oo  ^  ■  ||^U,OO|l0,oo 

[L tW(un^  Rtu0  5  OO  5  0*-p+  C  •  RtWo,oo) 
-LfTT(it*4-+  Rffo,oo,0*-P+  c-  RfW0,oo)]o, 


0,oo 


^0,< 


c^O 


c-  ||w0,, 


=  0  . 


□ 


00  Ho, 00 


The  following  proposition  is  a  differentiability  analog  to  Proposition  3  in  [13]. 

Proposition  23  Let  all  the  natural  states  have  the  same  domain.  If  the  Frechet  derivative  of 
a  bounded  map  F  at  u  exists,  if  ajj  =  +oo  and  if  (||VF(u,u)||  /  ||u||)  — >  0  as  ||u||  — >  0  uniformly 
in  u,  then  the  Frechet  derivative  of  the  map  S  :  Ut  — >  S  defined  by  S(vt)  =  Cf  at  ut  exists. 


Proof:  Calculate 


tf+^Koo)  -  £>0,oo) 


=  [L tF((u  +  v)tjr ->  Rtw0,oo)  -  L tF(utjr^  Rjwo  ,oo  )]o,oo 

=  [L tF(utjt~^  RtWo,oo  +  4 — >  0tiOO)  —  L tF(ut-\ — >  RfWo,oo)]o,oo 

=  [L tL(vf-\ — >  Rtwo,oo, — »  Ot,oo)  +  Ljl/F(ttiH — >  Rtwo,oo>  ^*4 — >  Otj0o)]o,oo  • 

First,  consider  the  map  ut  — ►  £“(wo,oo)  for  u>o,oo  fixed.  Clearly,  [L tL(utjr^  RtWo.oo, 
•+->•  Ot,oo)]o,oo  :  Co  ->•  T0,oo  is  linear,  and 

||LtW {uf  - p->  R<Wo,oo)  Vtjr^  Ot,oo)  ||0  ^ 

lim  - 


<  lim 

||t>*-|->Ot,oo||t— »o 


Wiuf-^  RtW0,oo,  «*+->•  Of  ,00  )  I 


K, 


-i 

u 


0  t,c 


=  0 


by  increasing  the  time  interval  of  the  norm  in  the  numerator  and  by  the  assumption  on  U. 


(Note  that  since  atjj  =  +oo, 


0  iff  u*4 -+  0*  < 


0.)  Now,  consider  S.  Define  an 
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operator  A (ut,  ■)  :  Ut  —*■  Cjv(£^o,oo>  ^0,oo)  for  some  positive  integer  N  by 

vt)\ (1^0,00)  —  [LjZ/(u  H  >  R,£ieo,oo >  ^  H  *  0t,oo)]o,oo  • 

Note  that  A  is  linear  in  vt-  Also,  define  an  operator  Q.(ut,vt )  :  Ut  x  Ut  —*  Cff(Uoj00,  Yo,oo)  by 

[r2(ltt ,  tty)] (^0,00)  —  [LA'Nfa  “t  *  Rt'W0,oo)^  'H  *  0t,oo)]o,oo  • 


It  follows  from  the  uniformity  hypothesis  on  W  that 

l|Lf Wfuf+^r  RtW0,oo,Vt^  0t,oo)||0tOO 


sup 

lim  lim  — 

l|wtllt-o  |H|t  |k||t-*-o 


1  +  Iko, 00  11(^00 


<  sup  lim 

U?0,oo  1 1  H — ?  CSO  1 1 — >0 


m\\t 

W(utjr+  Rt  100, 00,  «*+->•  Oi)00)| 


t,  OO 


K u 1  •  ||i>M — *  0 t,c 


=  0  . 


If  S  is  bounded,  then  A  is  bounded,  (see  Theorem  2,  Chapter  3  of  [2]). 

||£j1(TO,oo)|Io  oo 

sup - 

D#0  _  "  i  +  IKoollo,* 


[150  =  sup  —  M  =  sup 

«*  l  +  Kiif  «*  1  +  Klli' 


N 


<  sup  ■ 


F{utjr ->•  Rtu0  ,00)  || 


v  +  11^11^)  (l  +  Iko.oollo^oo)  u,v  -*■  +  Wut\\t  +  l|'t’0,oo  ||0,oo  +  Ufo  Ut  1 1  v0, 00  1 1  oi00 


F{utjr^  R4U0,c 


<  (2^  +  1)  -  sup 


F  (u*-H-  RtU0,oo)| 


1  +  (iKIlt  +  11^0,00  1 1 0,00 ) 


iv  —  (2  +  !)  ■  SUP  ,,  t 

u,v  1  +  \\UZ 


F  («*+-►  Rtuo,oo)|| 


\N 


=  (2"  +  !).  sup -MAIL  =  (2n  +  1).[]F0  . 
u  1  +  ||rt|| 

Hence,  S  has  Frechet  derivative  A  {ut,  •)  at  lit  with  remainder  £l(ut,  •).  □ 

We  will  need  the  following  two  definitions  in  the  next  proposition,  which  is  a  differentiability 
upgrade  (analog)  to  Proposition  4  in  [13] . 


Definition  24  The  input  space  U  is  shift- differentiable  if,  for  all  u  £  U, 

L hU  =  u  +  h  ■  d  +  e{h)  (4-3) 

where  d,  e(h)  £  U  and  lirn^o  ||e(h)||t  /h  =  0  for  all  t  £  K.  d  is  the  shift  derivative  of  u. 

A  shift-differentiable  input  space  U  is  also  shift-continuous,  as  mentioned  in  Appendix  C.  A 
shift-differentiable  input  u  does  not  necessarily  have  a  derivative  with  respect  to  time  (at  least 
not  everywhere;  see  Appendix  C.) 
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Definition  25  A  system  trajectory  is  a  shift- differentiable  system  trajectory  t  — ►  Ft  if 

LhFRh  =  F  +  h  ■  G  +  H(h)  (4-4) 

where  G  £  Cff(U,  Y )  and  H(h)  £  Cff(U,  Y )  and  such  that 

lim  =  0  for  all  t  £  K-  (4-5) 

h->o  h  K  ' 

Conditions  that  include  a  semigroup  generator  for  the  system  trajectory  for  a  shift-differenti¬ 
able  system  trajectory  are  given  in  Appendix  D.  Appendix  D  also  gives  conditions  so  that  (4-5) 
is  uniform  in  t. 


Proposition  26  Let  all  the  natural  states  have  the  same  domain.  Let  Hypothesis  D  from 
Page  2-6  hold.  Assume  that  the  input  space  U  and  the  system  trajectory  t  — ►  Ft  are  shift- 
differentiable  and  that  the  Frechet  derivative  L(u,  •)  of  F  exists  for  all  u  £  U .  In  addition,  with 
regard  to  the  shift  differentiability  ofU,  assume  that  lim^o  ||e(/i)||s  /h  —>  0  uniformly  for  s  <T 
for  all  T  £  K  for  each  u  £  U.  Also,  assume  that  (4-5)  is  uniform  in  t.  Then  for  all  u  £  U,  the 
state  trajectory  t  — >  £“  is  differentiable. 

Proof:  First  calculate: 


f,t+h  (A0,oo)  (^0,oo)  —  [L t-\-h,F(u  4  >  Ri+/iH0,oo)  L tF(u  4  >  RtUo,oo)]o,c 

—  4  ■>  Rt+h.vo,oo)  LjF'((L/1u)  4  *  fft,yoioo)]o,oo 

-\-[LtF(ut-\ — >  Rtuo,oo  +  ( hd  +  e(h)Y  4— >  0iiOO)  —  LtF(utjr^  Rtuo,oo)]o,oo  • 


So  then. 


£t+h(v0,oo)  ~  €t(vo,< 


=  lim 
h—>  0 


[Lt+hF(ut+h+->  Rt+hV0,oo)  -  LtF((Lhu)t-h^  Rtu0,oc)]o,c 


[Lt(L(n*4 — *  Rt'i’OjOO)  (hd  4-  e(h)Y~\ — >  0fjOo) 

+W(ut~F^  Rt.vo  oo,  (hd  +  e(h))tjr^  Ot,oo))]o,c 

4-  lim - - 

o  h 

Consider  part  of  the  second  term  on  the  right-hand  side  of  (4-7): 


[Lf(W (vf  4 — >  Rt^o,ooi  (hd  +  e(h)Y 4— >  Oti00))]o,c 


_  W(utjt~^  Rt.vot00,  (hd  +  e(h)y~\ — >  0j)OO)  (hd  +  e(h))tjr^  0t,oo 

<  lim - - - • - =  1  . 

h-^  o  ||  (hd  +  e(h)Y~\ — ►0ttOO||  h 


(hd  +  e(h)Y 4 — *  Of 


,oo  n.  (hd  +  e(h)Y Ot,c 

-  =  lim  sup - - - 

h — >0  s  h 


=  11  . 
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To  compute  this  limit,  there  are  two  cases  to  consider: 

(i)  s  >  t: 

II<||d||  +  limM^k  =  ||d| 
ti — >0  n 

(ii)  s  <  t: 


II  <  lim  sup 

h—*o  s<t 


f\M\s  +  \\e(h)l 


V 


< 


+  lim  sup 

h-^0  s<t 


\e{h)h 


=  Nil 


Therefore,  I  is  zero. 

Consider  the  first  term  on  the  right-hand  side  of  (4-7): 

H  [Lt+hF(ut+h-\ — >  Rt+/ifo,oo)  —  Lti71((L/ln)t-| — >  Rtuo,oo)]o,oo 

/i->o  h 


_  [Lf(LfeF(Rfe((Lfert)tH-+  R tU0;OO))  -  F((Lfeu)*H-+  RtU0;00))]o;00 

ft->0  h 

-  lim  +  hd  +  e{K)Y -\— ►  Rtuo,oo))  —  F((u  +  hd  +  e{K))t -\ — *  Rtuo,oo))]o,oo 

h-+ 0  h 

[L t(h  ■  G((u  +  hd  +  e(h)Y~\ — >  Ri^o  oo)  +  H(h)((u  +  hd  +  e{h)Y -\ — >  Rt^o  oo))]o,oo 

=  lim - 

h—>0  h 

where  G  and  H  are  from  Definition  25.  Now, 


H  [L t(h  ■  G((u  +  hd  +  e(h)y~\ — >  Rti>o,oo))]o,oo 

h— >o  h 


\J-‘tG{ut-\— >  Rt^o  ,oo  )]o,oo 


(4-9) 


And 


||  [L t{H{h){(u  +  hd  +  e{h ))  +- >  RiUo,oo))]o,oo||0  <*, 

lim - - - 2 — 

h— >0  h 

|| H(h)((u  +  hd  +  e(/i))*-H-  Rfy0,oo)||r 

<  lim  sup - - - - - 

h->  0  T  h 


<  lim  sup  •  (1  +  ||  (u  +  hd  +  e{h))tjr RtUo.ooll^)  =  0  • 

h— >  0  T  h 

Hence,  from  (4-7),  (4-8),  and  (4-9),  the  derivative  of  the  state  trajectory  t  — >  £“  is 

fu  (.)  —  £u(.) 

lim  t+h — - - —  =  [LtG(it*+- >  Rr)]o,oo  +  [Lt(T(u*-| — >  — >  0too))]ooo  -HI  (4-10) 

o  h 

Thus,  for  time-invariant  systems,  differentiability  of  the  natural  state  trajectory  follows  from 
the  general  conditions  and  the  shift  differentiability  of  the  input  FF.  Note  that  ul  appears  in 
(4-10).  However,  similar  to  Proposition  22,  any  element  in  the  Nerode  equivalence  class  of  uf' 
may  be  used.  Indeed,  consider  a  time  T  and  natural  state  £j.  and  suppose  there  is  v!  G  U  such 
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that  £j-  =  Ct-  Then  for  all  t>  T,  v  6  U  by  the  state  transition  property, 

(.UT++Vt,oo  _  fM,T4->-UT,oo 
St  —  St 

If  the  natural  state  trajectories  are  differentiable,  then  the  derivatives  of  the  natural  state 
trajectories  are  identical  for  all  t  >  T.  Hence, 

d(£t  )  =  d(€t  ) 

dt  dt  ’ 

for  all  t  >T,  where  for  t  =  T,  the  derivative  is  taken  from  the  right.  Assume  that  these  two 
inputs  are  shift  differentiable,  then  for  all  t>  T 

[L tG(u'T -\ — *  vT,t+^>  Rf)]o,oo  +  [L t(L(u'T-\ — *  vT't-\—>  R *•,</*+-»•  Ott00)]oj0o 

=  [L tG(uT-\ — ►  vT,t-\ I— ►  Rr)]o,oo  +  [L <t{L(uT-\-^  vT,t-\ — >  R <-,<^4 — >  Otj00)]o,oo  • 

For  t  =  T,  limits  are  taken  from  the  right  in  computing  these  terms.  Hence,  it  does  not  matter 
if  u' ,  d'  or  u,d  are  used  in  (4-10). 

From  Proposition  26  we  get  a  differential  equation  representation  for  the  natural  state 
trajectory: 

d£u 

-jj-  =  [L tG(utjr^  Rf)]o,oo  +  [L Rf, Ot)00))]o,oo  •  (4-11) 

Note  that  the  domains  and  ranges  of  the  two  terms  on  the  right  in  (4-11)  have  the  same  form 
as  the  domain  and  range  of  a  natural  state. 

Example  27  Consider 4  the  causal  input-output  system  described  by  a  second  degree  polynomial 
integral  operator  of  the  form 

POO  POO 

y(r)  =  [F(u)](r)  =  /  /  f(r,  iq,  r2)u(r  -  T\)u{r  -  T2)dTidT2,  -oo  <  r  <  oo  (4-12) 

Jo  Jo 

where,  purely  for  simplicity,  the  input  time  functions,  the  kernel  f,  and  hence  the  output  time 
functions  are  scalar  valued  ( otherwise  the  product  forming  the  integrand  must  be  defined  as  a 
tensor  product).  Obviously  such  a  system  is  time-varying  unless  the  kernel  f  is  not  actually 
a  function  of  its  first  argument.  It  will  be  assumed  that  f  (r,  T2,T2)  is  symmetric  in  t\  and 
t 2  ■  This  entails  no  loss  of  generality  since  symmetrizing  f  does  not  change  the  value  of  the 
integral .5  We  choose  ordinary  L2  norms  for  the  FF  of  the  input  space  and  the  L ^  norms  for 


4  This  example  is  a  continuation  of  Example  1,  [13]. 

5 From  the  definition  of  a  symmetrized  kernal ,  fsym  (r,  ti,  T2))  =  |  (/(r,  ri,  T2)  +  f{r,  T2,  ri)).  Hence , 
the  symmetry  property,  f3ym{r,T\,T2)  =  fsym  (r,  T2,  ti).  To  show  that  using  the  regular  (unsymmetrized) 
or  symmetrized  kernal  within  the  integral  (f-12)  is  the  same,  we  have  fsym(r,T i,t 2) dr \dr 2  = 

IZo  +  f(r,T2,T1))dr1dT2  =  §  fZo  IZo  f(r’  Tl’  T2)dTldT2  +k  f-oof-o0f(r’T2’Tl)dT2dTl  = 

JZo  IZo  f(r,Tl,T2)dT1dT2  ■ 
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the  FF  of  the  output  space.  Thus,  e.g., 


dt 


(4-13) 


||y||0  =  ess  sup  \y(t)\ 

— oo<£<0 

Finally,  assume  that  for  all  s  there  is  M  <  oo  such  that 


noo 

\f(s,T1,T2)\2dT1dT2  <  M 


(4-14) 


(4-15) 


We  now  determine  the  form  of  the  operators  Ft  and  First,  [Ft(ut)](r)  =  [F(«)](r)  for 
r  <  t,  so  Ft  is  given  by  Equation  (4-12)  with  — oo  <  r  <  t.  Then, 

[Fi(u0)](p)  =  [ LtFt(Rtu0)\(p )  =  [F(Rtu)](t  +  p) 

poo  poo 

=  /  f((t  +  p),Ti,T2)u(p-Ti)u(p-T2)dTidT2,  -oo  <  p  <  0  .  (4-16) 

Jo  Jo 

The  natural  state  is  given  by 


[£“(«0,oo)](<r)  =  \Lt£t  (Rtvo,oo)]{cr) 

=  [F(ut-h+  RtV0,oo)](t  +  a),  a  >  0  . 
Evaluation  of  the  right  side  of  (4-17)  yields 


(4-17) 


noo 

f(t  +  a,  a  +  Mi,  a  +  p2)u(t  -  Mi )u(t  -  m2)^Mi^2 

. 

noo 

f(t  +  a,cr  +  Mi)  T2)u(t  -  Mi )v(a  -  T2)dp1dr2 

_ 

n(J 

f(t  +  a, Ti,T2)v(a  -  t i)v(a  -  T2)dT\dT2,  a  >  0  . 


(4-18) 


We  need  to  consider  the  boundedness  and  continuity  of  the  system  operator.  Looking  at  the 
issue  of  boundedness:  From  (4-12),  (4-13),  and  (4-15)  it  follows  for  all  t  and  all  p  <  0  that 

poo  poo 

|[Fi(n0)](p)|  =  /  /  f((t  +  p),Ti,T2)u(p-Ti)u(p-T2)dTldT2 

Jo  Jo 

poo  poo 

<  /  /  \f((t+p),Ti,  r2)u(p  —  t i)u(p  —  r2)  \  dr \dr 2  , 

Jo  Jo 
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using  the  Schwarz  inequality, 


< 


roo  poo 


'0  Jo 


)l/z  /  poo  poo  \ 

(y  J  \u(p  -  Ti)u(p  -  r2)|2  dTidT2) 

/  /»oo  /»oo  \  1/2  /  /»oo  /»oo  \  1/2 

<  M  ■  (J  J  \u(p  -  Ti)\2  d,Tij  (j  J  \u(p  -  T2)|2  dT2) 


1/2 


From  (4-19), 


<  M  •  llnll 


I^MIIc 


(4-19) 


i^Ijv  =  sup  irtv:u:.'j°  <  m  SuP  :  "7° 


u£Uo  1  H-  ||,u||q  uEJJo  1  +  ||l^||o 

so  that  if  N  >  2,  the  Ft  are  all  bounded  by  M.  Then  by  (2-8),  [F[  <  M.  By  Appendix  A, 
or  Proposition  2  of  [13],  for  each  u  £  U ,  |£“[  is  bounded  in  t.  Uq  may  be  any  subset  of  Aq, 
including  Aq  itself.  Turning  to  the  issue  of  continuity, 

|[*i(«o)  -  «W)](P)| 

POO  POO 

=  /  f{(t  +  p),Ti,T2)  (u(p  -  Ti)u(p  -  t2)  -  u' (p  -  Ti)u' (p  -  t2))  dTidr2 

Jo  Jo 

POO  POO 

<  /  \f((t+p),T1,T2){u(p-Ti)(u(p-T2)-v!(p-T2)) 

Jo  Jo 

+  (u(p  -  T i)  -  u'(p  -  Ti))  u'ip  -  r2)}|  dridr2  , 
using  the  Schwarz  inequality , 

(poo  poo  \  1/2 

Jo  Jo  J^t+p^Tl,T2^2  dTldT2J 

(poo  poo  \  1/2 

J  J  \u(p  -  n)  (u(p  -  t2)  -  u'ip  -  r2))  +  (u(p  -  Ti)  -  u'(p  -  ti))  u'(p  -  t2)|  dT\dT2j 
using  the  Minkowski  inequality, 


< 


\  1/2 

\f((t  +p),ri,T2)\2  dTidr2 


ro  Jo 


+ 


/  /  POO  POO  \ 

\\J  J  \u(p  ~  T0  iu(p  ~  T 2)  -  u' (p  -  r2))\  dTidr2 J 

/  POO  POO  2  \  ] 

[j  J  \{u(p-Tl)-u'(p-Tlj)v!(p-T2)\  dr  ldT2j 

noo  \  1/2 

\f{{t+p),Tl,T2)\2  dT1dT2J 
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<  M  •  ||u0  -  u'0||0  •  (\\u0\\0  +  |K||0)  ;  (4-20) 

therefore,  Ft  is  continuous.  However,  if  Uq  is  unbounded  we  cannot  guarantee  that  Ft  is  uni¬ 
formly  continuous.  So  now  suppose  that  Uq  is  bounded,  ||«o||0  —  >  uq  G  Uq.  Then  by  (4-20) 

||Ft(n0)  -  Ft(«o)||0  =  sup \\Ft(u0)  -  Ft(u'0)}(p)  \  <  M  ■  2 M'  ||w0  -  u'0||0 
p<  o 


so  that  {Ft}  is  an  equicontinuous  family  of  uniformly  continuous  operators.  This  gives  that  F  is 
uniformly  continuous  (shown  in  Lemma  4  of  [13]).  Then  from  Appendix  A,  the  natural  states 
are  uniformly  continuous.  Furthermore,  it  follows  that  the  conclusions  of  Proposition  3  of  [13] 
(the  mapping  input  to  natural  state  is  uniformly  continuous)  and  Proposition  5  of  [13]  (future 
natural  state  depends  continuously  on  past  natural  state)  hold.  From  Proposition  4  of  [13]  the 
natural  state  trajectory  is  continuous  if  the  system  trajectory  t  — >  Ft  is  continuous  (e.g.,  the 
system  is  time  invariant). 

We  next  consider  the  differentiability  properties  presented  in  this  chapter.  To  start  with,  we 
consider  whether  the  system  (4-12)  has  a  Frechet  derivative.  We  have 


noo 

f(r,  ti,  t2)  ((u  +  v)(r  —  ti))  ((«  +  v)(r  —  r2))  dri(ir2 

noo 

f(r,  n,  r2)u(r  -  r \)u(r  -  r2)dri(ir2 

noo 

f(r,  ri,  r2)u(r  -  T\)v(r  -  r2)(iridr2 

noo 

f(r,  ri,  t2)v{t  -  t i)v(r  -  r2)dridr2  . 

We  compare  the  terms  of  (4-21)  with  those  in  Definition  21.  Looking  at  (4-12), 


noo 

f(r,  ti,  r2)u(r  -  T\)u(r  -  r2)dridr2  . 


Define 


^  POO  POO 

L(u,v)  =  2-  /  f{r,T\,T2)u(r  -  T\)v(r  -  T2)dT\dT2 

Jo  Jo 

and  we  see  L(u,-)  is  linear.  L  is  bounded  as  is  seen  from 

[ \L  (u,  •)  []  =  SUP  - 77—77 - 


(4-21) 


(4-22) 
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=  sup 

V 


supr  \2  •  /0°°  f0°°  f(r,T1,T2)u(r  -  Ti)v{r  -  T2)dTidr2\ 


<  sup 


2  •  supr  sj /0°°  f0°°  ||/(r,  ri,  T2) || 2  dr1dr2^ /0°°  /0°°  ||w(ri)u(r2)||2  dndr2 


=  sup 

v 


2  •  supr  /C  r  ll/(r>  rii  r2)l|2  dr1dT2\J ||n(ri)||2(iriy//0°o  ||u(r2)||2  dr2 


<  2M'J^  <  2M  •  Hull  . 


Define 


Then 


^  roo  r  00 

W(u,v)=  /  /(r,  ri,r2)v(r  -  T\)v{r  -  T2)dTidr2  .  (4-23) 

40  4o 


Um  H^7  (tt,^)||  =  Hm  supr  |  J0°°  /0°°  |/(r,ri,  r2)v{r  -  n)u(r  -  r2)|  dndT2\ 


M-o 


< 


M  ■  llv 

lim  - 7] — rp 

■wlHo  M 


=  0  . 


Hence  the  input- output  system  has  a  Frechet  derivative  and  this  decides  the  applicability  of 
Proposition  22.  We  see  that  (4-23)  is  uniform  in  u,  and  therefore,  Proposition  23  is  applicable. 
Looking  at  Proposition  26,  a  number  of  conditions  need  to  be  satisfied  for  this  proposition  to  give 
differentiable  state  trajectories.  The  shift  differentiability  of  L2  is  considered  in  Appendix  C. 
The  sufficient  conditions  of  Proposition  C-5  provide  that  u  €  L2  is  shift  differentiable  if  it  has 
a  time  derivative  and  has  a  bounded  remainder,  as  in  (C-6).  Our  system  trajectory  is  shift 
differentiable  if  it  is  time  invariant  ( this  is  a  sufficient  condition,  other  specific  cases  may  be 
considered.)  These  conditions  are  sufficient  for  Proposition  26  to  apply  to  this  input-output 
system.  Checking  into  the  form  of  (4-11),  if  the  system  is  time-invariant,  G  is  zero.  Then 


dfil 

dt 


\Lt{L{utjr^  Rf,  dtjr^  Ottoo))]o,oo  > 


where  d  is  the  shift  derivative  of  u.  Substituting  (4-22), 


dt 


(v0,oo)  (r) 


=  2 


noo 

f(t  +  r,  n,  t2)  («*+-►  Rtu0,oo)  (t  +  r-  n)  0tjOO)  (t  +  r-  T2)dT1dr2 


where  0  <  r  <  00. 
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5  SUMMARY  AND  CONCLUSIONS 


It  is  pointed  out  that  the  natural  state  set  is  unique  to  an  input-output  system  if  a  tapered 
input  space  is  used  (Proposition  16)  or  if  the  system  has  a  polynomial  integral  operator  rep¬ 
resentation  (Proposition  20).  (A  form  of  this  result  may  also  hold  for  the  differential  equation 
representation  in  Chapter  4.)  The  uniqueness  of  the  natural  state  space  to  an  input-output 
system  may  be  applicable  to  the  modeling  of  physical  systems  and  may  be  of  mathematical  in¬ 
terest.  That  is,  if  uniqueness  of  the  natural  state  space  to  a  system  is  evident,  then  steps  should 
be  taken  to  incorporate  this  feature  in  a  mathematical  model.  This  is  a  property  of  common 
system  representations  and  hence  may  already  be  tacitly  assumed.  For  instance,  linear  finite 
dimensional  time-invariant  differential  systems  are  uniquely  determined  by  their  natural  state 
space  (Example  10).  Example  8  shows  that  systems  modeled  with  excessive  memory  may  not 
uniquely  define  a  natural  state  space.  This  same  example  along  with  Proposition  15  showed 
that  reachability  is  affected  by  memory  length.  Sufficient  conditions  for  a  connected  natural 
state  space  are  given  in  Lemma  12.  Connectedness  and  reachability  of  the  natural  state  space 
may  also  be  properties  of  interest  in  modeling.  We  gave  conditions  in  [13]  for  the  map  from 
system  to  natural  state  space  to  be  well-defined. 

It  is  also  pointed  out  that  various  differentiability  properties  of  the  natural  state  and  natural 
state  trajectory  are  inherited  from  the  input-output  system.  These  results  are  differentiability 
upgrades  to  the  continuity  results  presented  in  [13].  Proposition  22  gives  that  if  the  Frechet 
derivative  of  the  input-output  system  at  u  exists,  then  the  Frechet  derivative  of  the  natural  state 
at  L tUtj0o  exists.  Proposition  23  gives  conditions  for  the  Frechet  derivative  of  the  map  from 
input  up  to  time  t  to  natural  state  at  time  t  to  exist.  Proposition  26  gives  conditions  such  that 
the  Frechet  derivative  exists  along  a  natural  state  trajectory.  This  proposition  has  the  result  of 
a  differential  equation  representation  for  the  natural  state  trajectory  (Equation  (4-11)).  These 
results,  as  well  as  their  Gateaux  derivative  versions,  mostly  appear  in  [14].  The  differentiability 
results  presented  in  this  report  also  may  be  considered  as  aids  in  modeling  of  physical  systems. 
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APPENDIX  A 

BOUNDEDNESS  AND  CONTINUITY  OF 
THE  NATURAL  STATE 


A-l/A-2 
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In  this  appendix,  we  demonstrate  that  the  natural  state  inherits  boundedness  and  continuity 
from  the  input-output  system.  NSWCDD’s  publications  format  guide  requires  that  appendices 
be  self-contained,  so  we  repeat  here  the  definitions  of  fitted  families  (FFs)  of  time  functions  and 
other  relevant  definitions  from  the  main  text  of  this  report. 

Definition  A-l  ([A-l])  Let  £  =  £(3ft,  E)  be  a  linear  space  of  time  functions  from  3ft  into 
a  Banach  space  E  such  that  any  translate  of  a  function  in  £  is  also  a  function  in  £.  Let 
J\f  =  {Hat,-00  <  s  <  t  <  00}  be  a  family  of  seminorms  on  £  satisfying  the  following 
conditions: 

(1)  For  /1,  /2  <E  C,  if  /i(r)  =  /2(r)  for  s  <t  <t  then  ||/i  -  f2  ||M  =  0. 

(2)  Let  Lt  denote  shift  to  the  left  by  t.  For  all  f  G  £,  ||LT/||s_r  t_T  =  ||/||st. 

(3)  Let  r  <  s  <t.  Then  for  all  f  G  £,  ||/||Sjt  <  ||/||rjt. 

(4)  Let  r  <  s  <  t.  Then  for  all  f  <E  £,  jj/jjrit  <  H/H^  +  ||/||S)t. 

(5)  There  exists  0  <  a  <  00  and  K  >  1  such  that  if  0  <  t  —  r  <  a  and  r  <  s  <  t,  then  for 

all  fe£,  \\f\\riS<  K\\f\\rjt. 

The  pair  (£,A f)  is  called  a  FF  of  seminorms  on  £.  The  normed  linear  space  formed  from 
equivalence  classes  of  functions  in  £  with  norm  ||-||st  is  denoted  A,t-  The  elements  of  ASyt  are 
the  equivalence  classes  determined  by:  f  g,  f,g  £  £  if  and  only  if  \\f  -  g\\st  =  0.  They  are 
denoted  uS}t,  ys,t>  etc.  The  set  {ASjt},  —00  <  s  <  t  <  00,  is  the  FF  of  normed  linear  spaces 
given  by  (£,A f). 

For  /  6  £,  put  ||/||s,t  =  sups<T<t  ||/||sr.  A  FF  and  {A,^},  —00  <  s  <  t  <  00,  can  be 

augmented  to  include  H-H.^  t  by  taking  the  limit  s  — >  —00,  since  by  (3)  of  Definition  A-l  ||/||s  t 
is  monotone  nondecreasing  as  s  — >  —00  with  t  fixed.  Let  Cq  =  {/  G  C\  lim^-oo  ||/||st  <  00, 
t  G  3ft}.  For  /  6  Cq,  define 

ll/ll,  =  l™  ll/ll,,  “ll/ll-ooj  •  (A-l) 

With  the  meaning  of  (£,A f)  thus  extended,  \\-\\st  is  defined  for  —00  <  s  <  t  <  00.  The  left- 
expanded  FF  of  seminorms  is  thereby  defined  and  is  denoted  (£o,Af).  It  still  satisfies  all  the 
Conditions  (1),  •  •  •  ,  (5). 

We  next  define  ||-||  and  Aj00.  For  a  FF,  this  is  done  by  taking  the  supremum.  Let 
£00  =  {/  e  A) I  supt  ||/||t  <  00}.  For  /  e  Coo  define 

ll/IUoo  =  SUP  Wf\\s,t  !  -00  <  s  .  (A-2) 

t>S 

It  may  be  readily  verified  that  if  ( C,Af )  is  a  FF  for  indices  satisfying  —00  <  s  <  t  <  00  then, 
with  definitions  given  by  (A-l)  and  (A-2),  (Coo,Af)  is  a  FF  for  indices  satisfying  —00  <  s  < 
t  <  00  and  satisfies  Conditions  1,  2,  3,  and  5  of  Definition  A-l  for  indices  —00  <  s  <  t  <  00. 
{(£oo>A),  IHU>  — 00  <  s  <  t  <  00}  is  called  the  expanded  family  of  seminorms  determined 
by  (£,Af). 

For  /  £  £00  j  we  put 

11/11=  sup  ll/ll,  =  ll/ll-oo.oo  ■  (A-3) 

The  normed  linear  space  consisting  of  equivalence  classes  of  functions  in  £00  with  the  norm 
(A-3)  is  called  the  bounding  space  A  for  the  family  For  —00  <  r  <  s  <  t  <  00,  and  h, 
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g  G  £,  the  splice  of  h  and  g  over  (r,  t]  at  s  is  defined  and  equals  /  if 


/  Mr)»  r  <  t  <  s 
/<T)  =  t  ,,(r),  s  <  T  <  t 

belongs  to  C.  It  is  denoted  frj  =  hr:S-\—>  gSjt.  For  t  =  oo,  the  splice  of  h  and  g  equals  /  if 

f(T\  -  I  h(T )>  r  <  r  <  s 
m  U(r),  s<r 

belongs  to  C.  It  is  denoted  fTtO0  =  hr,s-\ — >  gs,oo-  Let  $  be  a  mapping  from  a  norrned  linear 
space  X  into  a  norrned  linear  space  Z.  As  shown  in  Appendix  A  of  [A-2],  for  any  nonnegative 
integer  N,  the  IV-power  norm  for  is  given  by 


n  -  n  A  ||$(Z)|| 

M(N)  =  snp  - - 

x&X  1  +  X 


(A-4) 


when  the  right  side  exists. 

Boundedness  and  continuity  transfer  from  the  input-output  system  to  the  natural  state. 
Consider  the  boundedness  of  the  natural  state. 


un  =  sup 

^0,oo 


llff  (uo,oo)  1 1 0,00 

1  +  II^O.oo  Ilo,oo 


sup 

Vt,  oo 


£,  OO 


1  “1“  ||^t,oo 


I.  AT 
1 1  t,oo 


F  (VH-+  vt,oo)  | 


=  sup - 

Vt,o o  1  +  1 1  «*+->•  Vt,c 


t,  OO 


1+  ut 


Ut,oo 


N 


i  N 


1  +  II  Vt, 


\N 

00  llt,oo 


VU 


F  (utjr^  vt,oo)  1  +  ub 

<  sup  - •  sup  -  N 

Vt,  oo  1  +  ||u4-|  *  Vt,oo\\  Vt,o o  1  A  ||ut,oo llt]00 


lN 


vt,z 


/lr„  1  +  sup,  U  vt, oo 
-|F|'SUP 


I N 


I  . 


vt,< 


^•5°°  Nt,00 

There  are  two  cases  of  values  for  the  variable  “s”  in  I  to  consider, 
(i)  Suppose  s  <  t: 


I  <  IF1  •  (l  +  \\u\\N) 

(ii)  Suppose  s  >  t: 


I  < 


m  ■  sup 

Vt,  oo 


1  +  sups>t 


utjr- -+  vt,oo 


N 

s 


1  ||^t,oo 


II  AT 
Nt,oo 
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/ 


<1^1- 


1  +  sup 


(lKllt  +  IKc 


't.oo 


N' 


V 


Vt,oo  1  +  Mt,< 


iN 
1 1, oo 


J 


=  |F|  •  1  +  sup 

\  Vt,o o 


I  \\N  ,  II  || AT— 1  n  | 

Ml  +a/v-i|M|  IM,°°I 


t,  OO 


+  •  •  •  +  ao  |pt,c 


|  AT  ' 
U,oo 


l  N 


1  +  Mt,°o|lt)00  / 

where  ao,  •  •  •  ,  ajv-i  are  constants  obtained  from  expanding  the  numerator  of  the  previous  equa¬ 
tion.  This  last  expression  is  less  than  or  equal  to 

—  [MI  '  +  MU  +  CLjy—  i  ||rt||  +  •  •  •  +  ao'j  ■ 

Consider  the  continuity  of  the  natural  state. 


Mo,oo)  -  &  (wo,< 


1 0,oo 


(Rr^OjOo)  (Rr^O,oo) 


t,  oo 


=  ||F  (?/+->•  RrU0,oo)  -  F  (utjr+  Rr^0,oo)  ||f  oo 
<  ||F  («*+->•  Rr^O.oo)  -  F  (ut-\-^  RrU>0,oc)||  <  £  , 

provided 

1 1  a  -f  *  Rt^O,oo  a  -|  *  Rr 0^0,00  ||  —  Mo,oo  'O’OjOO  11^  ^  ^ 

for  5  =  5(e)  sufficiently  small.  Uniform  continuity  is  also  inherited  by  the  natural  state  from 
the  input-output  system. 
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APPENDIX  B 

PROOF  OF  PROPOSITION  20 
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SCALAR  CASE 


In  this  appendix,  when  two  systems  are  considered,  one  will  be  denoted  by  £“(ryi,oo)  and 
the  other  will  be  denoted  by  r)f(vo!00).  Differences  between  u  and  w  will  be  represented  by  z. 
At  times,  u  and  w  will  have  subscripts.  Even  when  this  is  the  case,  subscripts  will  usually  be 
omitted  from  differences  represented  by  z. 

Integral  Operator  Case 

We  propose  to  consider  the  A— degree  scalar  polynomial  case  of  our  problem.  First,  we 
consider  a  single  A— degree  term.  The  system  is  of  the  form:  (symmetric  kernel  is  assumed) 

poo  poo 

[F(u)](s)  =  ■■■  /(ti,---  ,tn)u(s  —  t\)  ■  ■  ■  u(s  —  TN)dT\  ■  ■  ■  drN  . 

Jo  Jo 

The  state  is  of  the  form: 


Ko('yo,oo)](o-)  =  [E(m0+->  u0,oc)](c) 


poo  poo 

/  •••/  f(ri,  •  •  •  ,ttv)(u04-^  ^0,oo)(o‘  -  Ti) 

Jo  Jo 

■  ■  •  (u04-^  v0,oc){v  -  TN)d,Ti,  •  •  •  ,  dr  AT 


poo  poo 


+ 


N 


■  /(r  1,  •  •  •  ,  tat)u(ct  -  Ti)  •  •  •  u(a  -  TN)dri  ■  ■  ■  drN 

J  <J 
poo 

■  /  /(r  1,  •  •  •  ,  rN)v(a  -  Ti)u(o T  -  r2)  •  •  •  u{a  -  tn)cLti  •  •  •  drN 

J  G 

/jj\  r&  r°'  r°o  poo 

+  (  )  /  /  /  •••  /  f(T1,---,TN)v(a-T1)v(a-T2)u(a-T3)---u(a-TN)dT1---dTN 

V  Z  J  Jo  Jo  Ja  Ja 


'  0  J  (j 


+  • 


+  J  ■■■  j  /(ti,  •  •  •  ,  TN)v(a  -  Ti)  •  •  •  v(a  -  TN)dn  •  •  •  drN 
where  the  integral  signs  and  the  dr'f  match  left  to  right.  Now,  replace  v  by  xv,  where  ieS, 

'if' x1  +  (^\  If  x2  +  •  •  •  +  (Z'\'nfxn 


where 


G  pOO  pOO 


nF  = 


io  Jo  Ja 


poo 

/  /(ti,  •  •  •  ,  r N)v(a  -  rn+ 1)  ■  ■  •  v(a  -  tn ) 

Ja  ' - V- - ' 


N—n 
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u(a  —  ri)  •  •  •  u{(i  —  Tn)dr\  ■  ■  ■  dr tv  . 

' - v - ' 

N-n 

Two  systems  are  being  dealt  with  as  before,  and  as  before,  put  h  =  f  —  g;  also,  since  the 
polynomial  is  zero,  each  of  the  coefficients  is  zero.  Hence, 


,  tn)v{<j  —  ri)  •  •  •  v(a  —  rjv)<iTi  •  •  •  dr  at  =  0 


for  all  v,  for  all  a  >  0.  Suppose  h(a\,  02,  •  •  •  otv)  >  0  and  the  a'f  are  all  different.  Set  Ai  = 
[di  —  d/2,  ai  +  5/2]  where  5  >  0  is  small  enough  such  that  A,L  n  Aj  =  0  for  i  /  j.  Also,  5  is  small 
enough  such  that  h{ji ,  •  •  •  ,  tn)  >  0  for  all  r4  G  A{.  Hence,  with  v(s)  =  1  on  A*  ;  =  0  else, 


for  all  i.  Next,  let 


/"7Mti - 

A,  Ai 


,  TAr)dri  •  •  •  dr  tv  =  0 


f  1,  s  G  Ai  U  Aj 
\  0,  else 


h(r  i> 


AiUAj 


AiUAj 


1  t  Tv)dr  1  •  ■  -  dr  TV 


,  r  Tv)dr  1  •  •  •  drN 


+ 


/• 


+  •••  + 


•  ,  rTv)dr  1  •  •  •  dr  tv 


,  T]y)dTi  ■  ■  ■  drjsr  =  0  . 


(B-l) 


This  with  the  above  gives 


,  t  N)  dr  1  •  •  •  dr  at 


Next, 


H - f  (^nN_  j  J  '  J  M7-!*  •  •  •  >  Tw)dr  1  •  •  •  dr  at  =  0  . 

Ai  Aj  Aj 

r  \  /  1  j  s  G  Aj  U  Aj  U  Ak 

”(s)  =  (  0,  else 
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/ 

AiUAjUAk 


/ 


h(r  i, 


^iUAjUAfc 


,TAr)dri  •  •  -  dr TV 


/  +m- 


J 


This  has  three  types  of  integrals:  Type  1  is  where  only  a  single  integral  interval  appears,  i.e., 
only  “A” ,  “ Aj ”  or  “A*,.”  These  are  referred  to  as  integrals  with  A,s  taken  one  at  a  time.  By  the 
above,  these  integrals  are  zero.  Type  2  is  where  all  possible  integrals  with  exactly  two  intervals 
appear,  as  Aj  and  Aj  or  Aj  and  Ai~.  These  appear  in  the  parentheses  above.  By  the  above, 
these  are  also  zero.  The  type  3  integrals  are  represented  by  the  “III”  in  the  above  equation. 
This  type  consists  of  all  integrals  where  Aj,  Aj,  and  all  appear.  Since  the  whole  thing  is 
zero  and  the  first  two  types  were  zero,  we  conclude  that  the  type  three  case  of  integrals  is  zero. 

We  proceed  to  consider 


/•••/  Mn, 

-AiU^U-UAjv 


,TN)dTi  ■  ■  •  dr  tv  • 


This  integral  is  split  up  into  the  sum  of  N  different  classes  or  types  of  integrals.  The  first  type 
is 


,  tn)cIti  ■  ■  ■  d,T tv  H - h 


,  TN)dri  ■  ■  ■  dr  tv  • 


Ai  Ai 


An  An 


It  has  been  found  that  these  are  zero.  The  last  type  is 


J  h(r  i,  •  •  •  ,  TTv)dr  i  •  •  •  dr  at  •  (B-2) 

A1A2  An 

The  types  1  through  N  are  integrals  with  the  appropriate  number  of  A'f  appearing.  As  we  have 
seen,  each  of  the  lower  integral  types  is  zero;  hence,  the  last  integral  type  is  zero.  Since  the 
kernels  /  and  g  are  continuous,  h  =  0,  so  we  have  /(r  1,  •  •  •  ,  ttv)  =  giji,  ■  ■  ■  ,  ttv)  Vti,  •  •  •  ,  ttv- 


N  th  Order  Scalar  Polynomial  Case 

Following,  we  consider  the  Nth  order  nonhomogeneous  case.  The  state  is  defined  by 

POO 

[£o (v0, 00)] (O’)  =  fo+  fi(r)[uo-h->  V0,oo](tf  -  r)dr 

Jo 

poo  poo 

+  /  /2(ti,t2)[uo+^  v0, 00] (o’  -  Ti)[u0-t— ►  u0)OO](o-  -  r2)dridr2 

Jo  Jo 

poo  poo 

H - \-  •••  /  fN(ri,- ■  ■  ,tn)[uo-^  v0jOO]((7 -Ti)- ■ v0jOO](a  -  TN)dTi- ■ -d,TN 

Jo  Jo 

/o+(J)  j  /i(r)u(<7  -  r)dr  +  ^  fi{r)v(a  -  r)dr 
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+ 


+ 


+ 


^*oo  /*oo 


'0  j  <7 


+ 


+  • 


N 


f2{ri,T2)u(a  -  Ti)u(a  -  T2)dT1dr2 
f2{ri,T2)v(a  -  Ti)u(cr  -  T2)dTidr2 

J  J  /2(t i,  t 2)v(a  —  t i)v(a  —  r 2)dr \dr 2 

■+(*)  /  "'J  f n{t  i  j  ■  ■  ■  iT  n)u(g  t"i)  ■  ■  ■  u(<j  t  N)dr  i  •  •  •  dr  N 


per  /*oo  roc 


'  0  J  (7  J  (7 


•  •  •  ,  r n)v((J  -  Ti)u(a  -  r2)  •  •  •  n(cr  -  Tjv)dri  •  •  •  drN 


H - ^  (jv)  /  J  ' ' '  'TN)v{cr  -  n)  •  •  -v(a  -  TN)dri  ■  ■  ■  drN  . 

Now  collecting  the  terms  by  degree  in  v: 

0)  /°  +  (q)  /  h(T)U(a  -  T)dr  +  (^)  J  J  f2(ri,T2)u((T-T1)u(<T-T2)dT1dT2 

H - ^  (  0 1”)  /  'J  ■  ■  ,rN)u(a  -  ti)  ■  ■ -u(a  -  r^drx- ■  ■  drN 

+  (l)  /  -  r)dr  +  J  J  f2(ri,T2)v(a  -  Ti)u(a-  -  T2)dT1dr2 

/at(ti,  •  •  •  ,  tn)v{g  -  t \)u(a  -  r2)  •  •  •  n(cr  -  T7v)dri  •  •  •  dr  at 

H - J  ’TN-i)v(a  -  Ti)  ■  ■ -v((7  -  TN-i)dTi- ■  ■  drN_i 

+  (iV^l)  /  J  J  ■  ■  ,tn)v{g  -  Ti)  ■  ■ -v(a  -  TN^uia  -  TN)dTi- ■  ■  drN 

+  (iv)  J  J  fN(Tl  r  ■  ■  ,tn)v{v  ~  Ti)  ■  ■ -v{v  ~  TN)dTi- ■  ■  drN  . 

Considering  two  systems  with  kernels  /  and  g,  and  with  the  difference  of  these  having  kernel 
h,  and  using  the  polynomial  argument  again,  each  of  the  terms  by  degree  in  v  are  individually 
zero.  By  what  has  previously  been  established,  for  the  N— degree  (in  v)  term  we  get 


+ - h 


N 


per  roc  roc 


'  0  J  (7  J  (7 


r<7  rcr 

/  •••  /  hN(ri,  •••  ,rN)v(a  —  T\)  ■  •  •  v(a  —  t  N)dr\  ■  •  ■  dr  N  =  0 

Jo  Jo 
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and  so  /ijv(t i,  •  •  •  ,  tn)  =  0  for  all  t\,  ■  ■  ■  t^.  Consider  the  (N  —  1)— degree  (in  v )  terms: 

J  ■  j  ,tat-i)  +  (^nN_  J  /iv(ri,---  ,rN)u(a  -  TN)drN 


N 

N-  1 


9n(t i,  •  •  •  (ct  -  tn )  ^ttv 

7 

u(cr  —  Ti)  •  •  •  v(a  —  TN-l)dT\  ■  ■  ■  dTN-1  =  0  . 


If  the  terms  inside  the  parentheses  are  continuous,  and  since  /n  =  9n,  setting  z  =  w  —  u 

N 


hN- l(T  1,  •  ‘  '  ,  T N-l )  =  - 


N  -  1 


/jv(t  1,  •  •  •  ,  Tn)z((T  -  TN)drN  . 


Continuing, 


\hN~i(T  i,  •  •  •  ,  r  at— i)|  <C  ,TAf)|drAr  , 


where  C  is  some  positive  constant  (z  is  assumed  bounded).  Taking  the  limit  as  a  — ►  oo  yields 
•  •  •  ,  rjv-i)  =  0  for  all  t\,  ■  ■  ■  ,  tjv-i,  since  we  assume  that  /at  is  absolutely  integrable. 
Now  going  back  through  the  terms  in  decreasing  order, 


J  Mri)  +  j  (f)  /  MTl,T2)z2(cr  -  T2)dT2 


+ 


poo  /*oo 


/iv(Ti,---  ,rN)zN(a  -  T2,-  ■  ■  ,  cr  -  TN)dT2  ■  ■  ■  drN 


v(a  —  T\)dr  i  =  0. 


If  the  terms  inside  the  parentheses  are  continuous,  and  u,  w  are  bounded,  then 


roo  poo  poo 

\hi(Ti)\<C2  \f2(ri,T2)\dT2-\ - \~CN  ■j  |/jv(ti,---  ,TN)\dr2- ■  ■  drN  , 

J  ( T  J  cr  j  (7 


where  the  C[s  are  positive  constants.  Taking  the  limit  as  a  — ►  oo  gives  h\{r)  =  0  for  all  r. 
Looking  at  the  zero th  degree  term, 

POO  POO  POO 

\ho\<Ci  |/i(t)|  dr  4 - \-CN  ■J  |/jv(ti,  •  •  •  ,  tn)\ dn  ■  ■  ■  drN  , 

J  c r  J  a  J  a 


where  the  C[s  are  positive  constants.  (The  C[s  in  separate  equations  are  not  the  same.)  Taking 
the  limit  o  — >  oo  gives  ho  =  0. 

We  summarize  the  necessary  conditions.  All  the  kernels  /i,  •  •  •  /at  are  absolutely  integrable 
and  continuous.  These  terms  also  need  be  continuous: 


,tn)z(<j  -  TN)drN  ; 


/n (t i ,  •  •  •  TN)z{o  -  tat-1,  a  -  TN)dTN-idrN 
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/tv(t  1,  •  •  •  TN)z(a  -  r2,  •  •  •  ,  ct  -  tn)cLt2  ■  ■  ■  drN  ; 

50 

/tv— i(t  1,  •  •  •  T TV— l)^-(cr  -  TN-l)dr N-l  ; 


/»oo 

/  /tv-i(ti,  •  •  •  ttv— lMo-  -  r2,  ■ 
J  <J 


,cr  —  t N-i)dr 2  •  •  •  dr tv~i 


/  f2{ri,r2)z(a  -  r2)dr2  ■ 

J  (7 

We  consider  sufficient  conditions  for  the  continuity  of  these  terms. 


r»oo  roo 

I  |  5  5  ’  5 7"i+l?  *  *  ’  5^  ^”Ar) 

J  (7 


lim 

->T I,-”  ,Ti 


'  •••T/  / 

1»  '  i  •/  cr 


— //v(rl>’"  ‘  ‘  ‘  ^n)z{g  —  Ti+1,  •  •  •  ,  cr  -  TjvOI  dTi+i  •  •  •  dr  n 


roo  p oo 


<  Const,  lim 


Tl>"’  J  a 


|/tv(^~i;**’  5 D? T^i ,  , ttv) 


Assume 


— ,Tj 

— /tv(ti,  •  •  •  ,Tj,Tj+i,---  ,  Tjv)|  dTj+1  •  •  •  d'TTV  • 


sup  /jvCt i,  •  ■  ■  >  1"*,  r j+i,  •  •  •  ,  ttv)  =  g(r i+ 1,  •  •  •  ,ttv) 

Tl,-”  ,Tj 


is  absolutely  integrable  (as  a  function  of  Tj+i,  •  •  •  ,  ttv)-  Hence,  from  the  Lebesgue  Dominated 
Convergence  Theorem: 

roo  /*oo 

,lim  ;  /  •••/  |/tv(t'i,  •  •  •  ,T-,Ti+i,  •  •  •  ,ttv)  -  /tv(ti,  •  •  •  ,tt,t*+i,  •  •  •  ,tn)\ dTi+i  ■  ■  -drN 

l  C"  "T i  J  a  J  a 


1  1»  •/O’ 

,r» 


r»oo  poo 


lim  ;  | /tv (t"i >  •  •  •  ,  r  ■,  Ti+i,  •  •  •  ,  ttv) 


J  cy  J  a  Ti 

— >ri,—  ,Ti 

-/tv(t i,  •  •  •  ,  Tj,  t j+i,  •  •  •  ,  ttv) |  dTi+i  •  •  •  dr  n  =  0  . 
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VECTOR  CASE 


Definition  of  Operator  and  Permutation 

The  system  at  hand  is  an  N— degree  homogeneous  integral  operator  with  M-dimensional 

input  space.  An  input  u  is  of  the  form  [u\ .  •  •  •  ,um\  with  norm  ||it||  s  t  =  max||uj||  t  and 

i  ’ 

||ui||st  =  sup  \ui(r)\.  Without  loss  of  generality,  the  output  space  has  dimension  one.  The 

’  S<T<t 

system  mapping  is  represented  by 


[F{u)]{t) 


, &N)uh{t  -  <7i)  •  •  •  UiN(t  -  aisr)da\  •  •  •  do n  , 


where  *i, •  •  ■  G  {1,  2,  •  •  •  ,  M},  not  necessarily  distinct.  Note  that  M  may  be  greater  than, 
less  than,  or  equal  to  N.  For  example,  if  N  =  2  and  M  =  3,  [«i,  *2]  =  (1, 1),  (2,  2),  (3,  3),  (1,  2), 
(1,3),  (2, 1),  (2,3),  (3, 1),  (3,2).  That  is,  these  are  the  values  [*1,^2]  take  on  in  the  above  sum. 
If  A  =  3andM  =  2,  [*1,13,13]  =  (1,1,1),  (2,2,2),  (1,1,2),  (1,2,1),  (2,1,1),  (1,2,2),  (2,1,2), 
(2,  2, 1).  There  are  MN  terms  in  this  sum. 

A  proposed  symmetrization  for  each  kernel  /  is 

,lN (h, ■  ■  ■  ,tN)  = 


where  n  is  the  permutation  of  N  ordered  symbols;  if  7r(ai,  •  •  •  ,  ajv)  =  (61,  •  •  •  ,  b^)  we  write 
7T (aj)  =  bi .  For  example,  in  the  above  sum,  if  N  =  3  and  [*i,*2,*3]  =  (1,2,3),  the  terms 
appearing  would  have  (1,2,3),  (1,3,2),  (2,1,3),  (2,3,1),  (3,1,2),  (3,2,1)  for  the  superscripts 
on  /at.  If  N  =  3  and  [*i , *2, *3]  =  (1,3,3),  the  terms  appearing  would  be  (1,3,3),  (1,3,3), 
(3, 1, 3),  (3, 1,  3),  (3,  3, 1),  (3, 3, 1).  There  are  N\  terms  in  this  sum.  Note  that  we  also  have  that 

,tN)  =  ,t%m) 

7 T 

and  we  will  use  this  form.  This  symmetrization  has  the  following  two  properties: 

(i)  -  For  the  first  property  consider, 


M 

E  Tr''N^w 

h,—  ,»jv= 1 


,0’N)lH1(t  -  <7i)  •  •  •  UiN  (t  ~  (J]\r)d(Ti  ■  ■  ■  d(JN 


0  M 

£  < 

\  ^  \  ^  /»^7r(l)  1’” 

(^7r(l) 

i I,--  ,%n= 1 

\  7T 

ki(t  -  (Ji)  ■ 

"UiN(t  -  (JN)d(Ji  •  • 

•  daw 

(B-3) 


Now,  consider  a  specific  set  of  indices  i\,  ■  ■  ■  ,ijv-  Suppose  that  there  are  I  distinct  indices  and 
a  particular  index  ij  is  repeated  rj  times.  Then  r\  +  r-z  +  •  •  •  +  77  =  N .  We  will  say  that 
the  outside  sum  cares  about  repeats  (takes  repeats  into  account),  but  the  inside  sum  does  not 
take  repeats  into  account.  Between  the  two  sums,  a  total  of  Nl  •  (^)  (JV~n)  •  •  •  (Ar_(ri+”’+T'r-1)) 
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number  of  terms  are  generated  for  the  specific  set  under  consideration.  But,  there  are  only 
(r[)  ^rJ1)  ' ' '  (N~^ri+r'i'+ri~1'>^  different  ways  to  permute  this  specific  set.  In  each  term,  there 
are  four  sets  of  indices: 

1.  The  “superscript”  indices  on  “/” 

2.  The  indices  associated  with  the  a,s  on  the  argument  of  / 

3.  The  indices  on  the  u,s 

4.  The  indices  on  the  arguments  of  the  u,s 

First,  assume  no  repeats  in  the  outer  sum,  i.e.,  all  r*  =  1.  Note  that  (^)  (^j)1)  •  •  •  (i)  (i)  = 
TV!.  With  the  inner  sum,  in  this  case,  there  are  TV!  ■  TV!  terms.  Each  of  the  TV!  outside  sum 
“base”  terms  (a  term  on  the  left-hand  side  of  (B-3)),  is  permuted  TV!  times  by  the  inner  sum. 
Take  a  specific  outside  “base”  term  with  the  indices  in  a  specific  order.  Of  the  TV!  terms  it 
gives,  only  the  identity  permutation  term  has  its  indices  in  the  specified  order: 


Z1’"'  ’^Ol,  •  •  •  ,  (JN)ui{t  -  (Ji)  •  •  •  uN(t  -  crN) 


(B-4) 


However,  each  of  the  other  outside  “base”  terms,  of  the  form 

~  7r(l),---  ,7t(N) 

f  (^"lj  ?  ^l)  ’  ’  ’  'U'tt(N)  (j'  °n)  i 

has  a  single  term  with  the  permutation  7r_1,  which  has  indices  in  the  specified  order 

Z  (^"71  1  (1)  1  '  '  ’  j  1  (iV)  )^7r(l)  ^l)  'U'Tr(N)  &n) 

Z  (^"71  ^ ( 1 ) ?  7  ^7r— 1(1))  '  '  '  ^N{t  RlV))  •  (B-5) 

However,  (B-4)  and  (B-5)  are  identical,  since  there  are  TV!  such  terms  and  since  the  inside  part 
of  (B-3)  is  divided  by  TV!,  we  see  that  under  the  condition  of  all  =  1  the  symmetrization  does 
not  alter  the  operator. 

Next,  suppose  r\  7^  1  and  all  other  rt  =  1.  With  the  indices  in  their  specific  order,  the 
outside  term  is 

- 1-1,2,  -  ,p 

Z  (<H,  ^2,  •  •  •  ,<JN)ui(t  -  a  1)  •  •  -ui(t  -  ari)u2(t  -  ari+ 1)  •  •  -uP(t  -  crN)  . 

This  term  gives  ri!  inner  terms  with  indices  in  this  order,  and  they  are  all  identical.  Now,  there 
are  ()^)  •  (TV  —  n)!  “outside”  terms  with  these  indices  in  any  order;  so  far  we  have  considered 
one,  the  one  with  the  indices  in  the  specified  order.  Each  of  these  other  “outside”  terms  gives 
?’i!  inner  terms  with  these  indices  in  the  specified  order.  Total  number  of  terms  in  the  specified 
order  are  (^)  •  (TV  —  n)!  •  ri!  =  TV!.  However,  dividing  by  TV!  gives  the  symmetrization  and  once 
again  does  not  alter  the  operator. 

Now  for  a  couple  of  examples:  First,  consider  three  distinct  indices 

-123  , 

z  (0-1,  (72, 0-3)  =  ^[f123{a1,a2,a3)  +  f213(a2,cri,a3)  +  f312{a3,a1,a2) 
+f132(cr1,a3,a2)  +  f231(cr 2,ct3,cti)  +  f321(a3,  a2, 04) 
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-213  .. 

/  (<Xi ,  <72,  O3)  =  ^[/123(cJ2,CTi,0-3)  +  /213(CJ1,CJ2,CJ3)  +  /312(a3,CJ2,Cri) 

+/132(0-2,  0-3,C7i)  +/231(0-i,CT3,CJ2)  + /321  (0-3, 0-1,  ^2) 

-312  1 

/  (O-I,  0-2,  O-3)  =  t^[/123(0-2,0-3,0-1)  +  /213(0-3,0-2,0-l)  +  /312  (o’!  ,  02 ,  O-3) 

+/132(0-2,0-l,0-3)  +  /231(0-3,0-l,0-2)  +  /321(0-1,0-3,0-2) 

-132 

/  (o'! ,  0"2,  0-3)  =  ^[/123(o-i,cr3,0-2)  +  /213(cr3,0-i,cr2)  +  /312(o-2,cri,0-3) 

+/132 (o-l,  0-2,  0-3)  + /231  (0-3,  0-2,  0-1)  + /321  (o-2, 0-3,  0-1) 

-231 

/  (di,  0-2,  0-3)  =  ^[/123(o-3,CJi,0-2)  +  /213(fJi,0-3,cr2)  +  /312(o-2,cr3,cri) 

+/132(0-3,0-2,0-i)  +/231(0-i,0-2,0-3)  + /321  (o-2, 0-1, 0-3) 

-321  .. 

/  (O’!,  (72,  0-3)  =  ^[/123(0-3,CT2,0-l)  +  /213(c72,0-3,(Tl)  +  /312(0-l,Cr3,0-2) 

+/132(o -3,  0-1,  o-2)  +  f231(cr2,  0-1, 0-3)  +  /32Vi,  o-2, 0-3)  . 

Sum  and  integrate  the  /231  terms.  For  example: 

J  /231(o-2,o-3,o-i)ui(t  -  o-i)u2(t  -  cr2)u3(t  -  0-3) 

+  J  /231(o-i,  0-3,  a2)u2(t  -  o-i)rti (f  -  a2)u3(t  -  0-3) 

+  J  /231(o-3,  0-1,  cr2)u3(t  -  o-i)rti (t  -  <r2)u2(t  -  <r3) 

+  J  f231{cr3,a2,cr1)ui(t  -  ai)u3(t  -  a2)u2(t  -  a3) 

+  J  /231(o-i,o-2,o-3)u2(t  -  ai)u3(t  -  cr2)ui(t  -  <j3) 

+  J  /231(o-2,o"i,  0-3)113 (t  -  <Ji)u2(t  -  a2)ui(t  -  0-3)  . 

These  terms  are  identical.  For  the  second  example,  consider  the  N  =  3,  M  =  2  case  given 
above.  In  this  example,  the  left-hand  side  of  (B-3)  is 

,.  - 111 

/  /  (o-l,0"2,0-3)lil(t  -  0"i)ui(t  -  o-2)iti(i  -  0-3) 

,.  -112 

+  f  (o-l,0-2,0-3)lil(t  -  (7l)ltl(t  -  <J2)u2(t  -  0-3) 
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+ 

+ 


-121 

f  (a1,a2,a3)u1(t  -  ai)u2(t  -  a2)ui(t  -  03) 
-122 

f  (a i ,02,  03)^1  (*  -  cri)u2{t  -  cr2)u2(t  -  a3) 

-211 


+ 

+ 

+ 


/  (o-i,o-2,o-3)«2(i  -  o-i)ui(i  -  cr2)lti(t  -  cr3) 

-212 

/  (cri,  cr2,  a3)u2(t  -  (7 1)1X1  [t  -  <J2)u2{t  -  03) 
-221 

f  (a  1  ,cr2,a3)u2(t  -  cr\)u2(t  -  cr2)ui{t  -  03) 


+  J  f  (ei,P2,<?z)u2{t  -  <Ji)u2(t  -  cr2)u2(t  -  03)  . 

Take  all  terms  with  n  =  2  and  r2  =  1.  Expand  these  using  the  inner  sum, 

-112  .. 

f  (<ri  ,<r2,a3)  =  ^{fU2(a1,a2,a3)  +  fU2(a2,alla3)  +  f121{ai,a3,a2) 


f121{cr 2,£73,<Ti)  +  f211{<J3,<Jl,<J2)  +  /2U (03 ,  02,  Oh)} 

-121  .. 

/  (cri,  cr2,  cr3)  =  —  {/121(<Ji,  cr2,  03)  +  /121(ct3,  cj2,  <xi)  +  /112(oi,  03,  <r2) 

/U2(o-3,0-1,0-2)  +  /21V 2,0-1, 0-3)  +  /211(a2,C73,(7i)} 


-211 


1 


/  (<Ti,  02,  CJ3)  =  -^{/211(o-i,  cr2,  <73)  +  /21Vi,  03,  cr2)  +  f121{a2,  cri,  cr3) 

/121(o- 3, 0-1,  cr2)  +  /112(ct2,  CT3,  cri)  +  /n2(cr3,  0-2,  ai)}  . 

Pull  out  and  put  into  integrals  the  terms  with  indices  in  the  order  “1, 1,  2,”  for  example, 


1 

3! 


[{/  (o-l,  0-2,  O’ 3)  +  /  (<T2,  0-1,  0’3)}ltl(i  -  <Tl)wi(<  -  cr2)u2(t  -  03) 


{/112(cn,  CT3,  02)  +  /112(0 ’3,  cri,  0-2)}«i(t  -  <J\)u2(t  -  U2)ui(t  -  0-3) 
{/112(02, 03,  cri)  +  /112(o-3,  02,  <Ji)}u2(t  -  (Ji)ui(t  -  a2)ui(t  -  a3)]daida2da3 


These  terms  are  all  the  same.  The  first  property  is  that  symmetrization  does  not  alter  the 
operator. 

(ii)  For  the  second  property  consider, 


1 

M 


fx’"',lN(cri,  ■  ■  ■  ,aN)uh(t  -  cri)  •  UiN (t  aN) 

-  cri)  ■  ■  -UiN(t  ~  <JN)  . 

7 r 


(B-6) 
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Also 

Tn  D’  ’lp(N>  ’  ’  ’  >  crJv)%( i)  (t  -  ^1)  •  •  •  %(JV)  (i  -  o-jv) 

=  ’Mp(JV))(<rT(i),-"  ,v*{N))uipm{t  -  ax)  ■  ■  ■  uip(N){t  -  aN)  .  (B-7) 

7T 

Show  (B-6)  equals  (B-7)  (this  is  the  second  property).  Take  a  particular  term  out  of  (B-6),  that 
is,  fix  7 r, 

fN  1)’  ’’'WK(l)r--  ,^n(N))Uh(t  ~  (Tl)  ■  ■  -UiN(t  ~  (TN)  . 

There  exists  it'  such  that  it  =  ir'p.  Take  this  term  out  of  (B-7) 

/V„(D’  ’VV(iV)  (a7r,(1)j . . .  5  an,(N))uip(1)  (t-a i)  •  •  •  uip(JV)  (t  -  aN) 

f N  (<^r7T,pp_1(l)  ,  !  ^7T'pp_1(iV))^ip(l)  (^  _  °"l)  '  '  '  '^ip(N)  —  <Hv) 

= /nW’  ’*’r(JV) (cr^-p-lci), -  ■  ■  ,<TWp-l(JV))«i/>(1)(i-<Tl)---1ti(„(JV)(i-<Tjv)  • 

Let  7"p(i)  o"i>  ■  ■  ■  i^p{N)  &Ni  then  cr^p- i(i)  ’Cr(i), ' ' '  , Trp_1(iV)  Hence, 

=  /^(1K"  ’lw(N)  (T^(1)>  •  ■  •  >  r^(iV))%(1)  (t  -  rp(1))  •  •  •  uip(N)  ( t  -  Tp(N))  . 

Since  p  is  1  to  1, 

=  fNW'  ’t7r(JV)  1),  •  •  •  rT^N^Ui^t  -  Tl)  •  •  •  UiN  (t  -  Tjv)  • 

As  an  example,  let  N  =  6  and  {ii,  i 2,  '<3,  *4,  is,  *6}  =  {1,2,  3, 4,  5,  6}.  Let  the  permutations  be 


1  2  3  4  5  6 
7 r  2  1  3  5  4  6 

p  3  4  6  5  2  1 

tt"1  2  1  3  5  4  6 

p~l  6  5  1  2  4  3 

7 rp"1  5  6  1  4  2  3 


Then,  using  rp^  =  <7j,  a  1  =  7-3,  cr2  =  r4,  CT3  =  r6,  cr4  =  r 5,  05  =  r2,  06  =  ri.  Computing, 


^~7r(l)  ^"2  5  ^tt(3)  ^”3  j  ^"77(5)  ^"4 

^~7t(2)  ^~1  5  ^7t(4)  ^5  5  ^”77(6)  ^6 

Then, 

^7Tp— 1(1)  ^5  ^~2  ^"77(1)  ^TTp— 1(4)  ^"4  ^”5  ^~7t(4) 

^np— 1(2)  ^6  ^77(2)  ^TTp— 1(5)  ^2  ^”4  ^”77(5) 

^7Tp— 1(3)  ^"1  ^”3  ^~7r(3)  ^7Tp— 1(6)  ^3  ^”6  ^77(6) 
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As  a  second  example,  try  a  different  ir  with  the  same  p: 

1  2  3  4  5  6 

7 r  4  2  1  5  3  6 

p  3  4  6  5  2  1 

7T— 1  3  2  5  1  4  6' 

p-1  6  5  1  2  4  3 

Trp”1  2  5  6  4  1  3 

Computing, 

^"7r(l)  1  4  7  ^~tt(3)  ^~1  7  ^~3 

■Cr(2)  ^~2  ?  Tt(4)  T5  ,  ^~7r(6)  ^"6 

Then, 

l^'7rp_1(l)  *^2  ^"4  (1)  &Trp- 1(4)  ^"4  T~5  ^"7r(4) 

<Trp_1(2)  7"2  7"tt(2  )  ^irp~  1(5)  ^"3  ^~7r  (5) 

^7rp-1(3)  *^6  ^  1  ^"7r(3)  &TTp~  1(6)  ^3  ^"6  T~7r(6) 

The  first  property  shows  that  the  proposed  formula  gives  the  symmetrization  and  the  second 
property  is  the  one  needed  in  the  development. 

Integral  Operator  Case 


The  second  system  is 


Now, 


[£o(wo,oo)](s)  =  [F(u0+- ►  v0,oo)](s) 


r»oo  poo 


roo  M  _ 

/  X]  '"’lN(<n,- ■  •  ,o-Ar)(nii-h^  Uii)(s  -  ai) 
Jo  ,  : 


^*oo  /*oo 


u,---  ,»jv=1 

•  •  (uiN-\-^  -  °N)d(Ji  ■  ■  ■  da N  . 

[Vo(v0,oo )](«)  =  [G(w0-i — *  v0,oo)](s) 
M 

^  - — 7.1  .  •••  A  AT  /  \  / 

w- 


PO o 

/  X]  ’^(cri,  -  -  -  ,<Tjv)(wii-l— >•  ^i)(s-o-i) 
•  •  •  (wiN-h^  ViN)(s  -  aN)dai  •  •  •  daN  . 


KoKoo)Ks)  = 


f*00  POO 


•••  /  vil)(s  ~  ai) 

Jo 

(u^- I— ►  -  aN)dax  •  •  •  dajv 


r»oo  /*oo 


H - H  /  •  /  /7 '  ■  •  ,^Jv)(%-H  %)(s  -  i) 


J 

/o  40 

•  •  •  ^  UjM)(s  -  (Tiv)d(7i  •  •  •  dcJAT  . 
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Consider  a  summand  with  the  difference  kernel  “h" 


’lN(cri,  ■  ■  ■  ,crN)vi1(s  -  a±)  ■■■ViN(s-  aN)da\  ■  ■  ■  daN  . 


The  possible  input  indices  ■  ■  ■  ,zn  £  { 1 , 2,  •  •  -  ,  M}  may  be  listed  in  order  in  h1^' )lN  since 
/ijv  is  a  symmetric  kernel.  These  indices  may  be  repeated,  such  as 


l\  —  '  —  In  :  Vi+1  —  '  —  ^r\+r2i 

i  Vi+r2-t - H\r_i+1  =  •  •  •  =  lri+r2-\ - h 77 

such  that  ?’i  +  r2  +  •  •  •  +  rj  =  N.  Using  the  “v  — >  xv'n  argument,  we  may  focus  on  a  single 
summand:  (a  summand  of  highest  order;  i.e.,  having  the  greatest  number  of  v's ) 

r\  r2  ri 

1n"  'lN  (<7i ,  •  ■  ■  ,  <JN)dai  ■  ■  ■  da  N  =  0  (B-8) 

A\  A2  Aj 

where  the  A'f  are  intervals  as  in  the  scalar  case.  For  the  partitions  A\,  A2,  •  •  ■  ,  Aj_i  fixed,  we 
use  the  technique  used  in  the  homogeneous  scalar  case  on  the  Ith  (last)  partition  to  show  that 

r\  r2  ri 

h1^'  " ,lN  (<7i,  •  •  •  ,ajsr)dai  ■  ■  ■  da n  =  0  .  (B-9) 

Ai  A2 

We  move  to  the  I  —  1th  partition.  We  repeat  the  same  procedure.  Finally,  we  find 

n  r2  rj 

j  Jty'" ,lN (ai,  ■  ■  ■  ,aN)dai  •  •  •  daN  =  0  . 

Aiti—AiiriA2,i—A2,r2  Aix--Airi 

Going  from  (B-8)  to  (B-9)  is  analogous  to  going  from  (B-l)  to  (B-2)  in  the  scalar  case.  Since 
/  and  g  are  continuous,  h  =  0,  so  we  have  /  =  g. 


N  th  Order  Vector  Polynomial  Case 


[F(u0-h^  u0,oo)](s) 


,aN){ui!-\ — ►  vh)(s  -  cri) 


+ 


•  •  •  viN)(s  -  a N) da  1  •  •  •  daN 


M 

E  vh)(s 

,®JV— 1=1 


CTl) 


B-15 


NSWCDD/TR-08/3 


•  •  •  (uiN_1-\ — *•  ViN_1)(s  -  <jN—i)d(Ji  ■  ■  ■  da N -i 

+  ••• 

poo  poo  M  ^ 

+  /  y2  ftNZ2(cri,(J2){ui1-h^  vh)(s  -  ai)(ui2-h^  Vi2)(s  -  a2)da1da2 

Jo  Jo  I 

21,22  =  1 

POO  M ^  ^ 

+  /  y2fN{a)(ui^  Vi)(s  -  a)da  +  f0  . 

i= i 

As  with  the  scalar  case,  we  start  with  the  higher  order  terms  and  work  toward  the  lower 
order  terms.  As  before,  we  set  up  two  systems,  one  with  kernel  “/”  and  one  with  kernel  “g" . 
For  the  difference  between  the  two,  we  use  the  kernel  uh” .  It  is  obvious  by  what  has  already 
been  done,  that  the  hfy'" ,lN  terms  are  zero.  Consider  an  JV-1  degree  term:  Fix  a  set  of  indices 
•  •  •  ,  LV-1- 


PS  PS  - - 

/  •••  /  -  ■  ■  ,<TN-i)v^{s-ai)---vT—(s-aN-i)dal---daN-1 

Jo  Jo 

C  POO  PS  PS  - - 

+^2\J  J0  •••  Jo  In’"' ,lN~utN  far  •  •  ,<TN)vz(s-a1)---v^{s-aN-1) 

2  N 

uiN  (s  —  a N)da i  •  •  •  da n 

POO  PS  PS  —  - _ 

-  /  "'  /  9n’"'  ,tN~1,tN  (<T1,  •  •  •  ,  <tn)%(s  -  <ti)  •  •  •  -  <TN-i) 

i/  s  i/  0  i/  0 

WiN(s  -  aN)dai  ■  ■  -daN}  . 

The  sum  is  over  all  possible  ipj.  Letting  z  =  u  —  w  and  using  the  polynomial  argument 


'{lN  \a  i,--  -  ,ctat_i)  +  ^  /  1  ,tN  {a  i ,  *  *  *  ,  aN)z{s  -  aN)daN 


iN 


%(s  ~  ai)  •  •  ■  %lvrr(s  ~  <JN-i)dai  •  •  •  daN-i  =  0 
If  the  terms  inside  the  parentheses  are  continuous, 


hlx’IiN  1  (^i ?  *  *  *  ,vN-i)  =  /  flN  "’iN  ,vn)z(s  -  aN)daN  . 


in 


The  same  limit  argument  used  in  the  scalar  case  shows  that  the  RHS  is  zero;  hence, 


hx’l i’  •  Hcri,---  ,aN-i)  =  0  . 


Looking  at  what  has  been  done  so  far  and  at  the  scalar  case,  it  may  be  found  that  the  kernels 
for  the  lower  degree  terms  are  zero  as  well.  The  continuity  conditions  are  summarized  below: 
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ft  I,’"  ,*iV 

In  l^i)  ‘ 


,  cr n)zin(s  -  ajy)daN 


iaN)ZiN_ltiN(s  -  aN- 1,  S  -  (TN)d(TN-ld(TN 


/*oo  roo  ^ 

/  •••  /  •  •  •  ,VN)zi2,...,iN(s- <J2,-- ■  ,S  -  aN)da2- ■  ■  daN 

J  s  J  s 

are  all  continuous.  Similarly  for  the  lower  degree  terms.  Sufficient  conditions  for  continuity  of 
these  terms  are  similar  to  before;  the  Lebesgue  Dominated  Convergence  Theorem  is  used.  Also 
as  before,  the  kernels  need  to  be  absolutely  integrable  in  the  polynomial  case. 
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APPENDIX  C 

ON  SHIFT  DIFFERENTIABILITY  OF  TIME  FUNCTIONS 
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In  this  appendix,  we  present  conditions  that  imply  the  shift  differentiability  of  a  space  of  time 
functions.  NSWCDD’s  publications  format  guide  requires  that  appendices  be  self-contained, 
so  we  repeat  here  the  definitions  of  fitted  families  (FFs)  of  time  functions  and  other  relevant 
definitions  from  the  main  text  of  this  report. 

Definition  C-l  ([C-l])  Let  C  =  £(R,  .E)  be  a  linear  space  of  time  functions  from  SR  into 
a  Banach  space  E  such  that,  any  translate  of  a  function  in  £  is  also  a  function  in  £.  Let 
J\f  =  { || •  lls  t ,  — 00  <  s  <  t  <  00}  be  a  family  of  seminorms  on  £  satisfying  the  following 
conditions: 

(1)  For  /i,/2  G  C,  if  /i(r)  =  /2(r)  for  s  <t  <t  then  ||/i  -  f2\\S)t  =  0. 

(2)  Let  Lr  denote  shift  to  the  left  by  r.  For  all  f  G  £,  ||LT/||S_T  t_T  =  ||/||st. 

(3)  Let  r  <  s  <  t.  Then  for  all  f  G  £,  ||/||S)t  <  ||/||r  r 

(4)  Let.  r  <  s  <  t.  Then  for  all  f  G  £,  j|/j|r|t  <  ||/||rjS  +  ||/||a)t. 

(5)  There  exists  0  <  a  <  00  and  K  >  1  such  that,  if  0  <  t  —  r  <  a  and  r  <  s  <  t,  then  for 

all  fee,  ||/||riS<^||/||r>t. 

The  pair  (£,  A f)  is  called  a  fitted  family  of  seminorms  on  £.  The  normed  linear  space  formed 
from  equivalence  classes  of  functions  in  £  with  norm  ||-||st  is  denoted  ASjt.  The  elements  of 
Asj  are  the  equivalence  classes  determined  by:  f  ~  g,  f,g  G  £  if  and  only  if  \\f  —  g\\st  =  0. 

They  are  denoted  uS:t,  ys,t>  etc.  The  set  {Asj},  —00  <  s  <  t  <  00,  is  the  FF  of  normed  linear 

spaces  given  by  (£,AT). 

A  FF  (C,J\f)  and  {AS)t},  —00  <  s  <  t  <  00,  can  be  augmented  to  include  H-H.^  t  by  taking 
the  limit  s  — >  —00,  since  by  (3)  of  Definition  C-l  ||/||  t  is  monotone  nondecreasing  as  s  — >  —00 
with  t  fixed.  Let  Cq  =  {/  £  C\  lim^-oo  ||/||s  t  <  00,  t  G  R}.  For  /  G  £0,  define 

ll/ll,  =  .Js.il/IU  =ll/ll-co,t  •  (C-l) 

Let  £0o  =  {/  G  £o|  supt  ||/||t  <  00}.  For  /  G  £0o  define 

•l/l.s.oc  =  SUP  \\f\\s,t  ;  -00  <  8  .  (C-2) 

t>s 

For  /  G  £00  we  put 

11/11=  sup  ll/ll,  =||/||_00,00.  (C-3) 

t& R 

The  normed  linear  space  consisting  of  equivalence  classes  of  functions  in  £00  with  the  norm 
(C-3)  is  called  the  bounding  space  A  for  the  family 

Definition  C-2  The  space  of  time  functions  U  is  shift,  differentiable  if  for  all  u  G  U 

L hU  =  u  +  h  •  d  +  e(h)  (C-4) 

where  d,  e(h)  G  U  and  lining  lle(^)llf;  /h  =  0  for  all  t  G  R.  d  is  the  shift,  derivative  of  u. 

Shift  continuity,  as  it  is  stated  in  [C-2],  is  the  space  U  is  shift,  continuous  if  lining  \\u  ~  Lhu\\s  t 
=  0  for  all  u  for  which  the  norm  is  defined  and  for  all—  00  <  s  <  t  <  00.  From  Definition  C-2, 
we  see  shift  differentiability  implies  shift  continuity. 
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Before  going  to  our  result,  we  start  out  by  showing  that  differentiability  or  continuity  is  not 
a  requirement  for  shift  differentiability  by  these  two  examples: 

Example  C-3  Let  the  basic  function  space  £(3i,  3?)  be  the  set  of  real-valued  functions  on  that 
are  bounded  and  piecewise  continuous  ( continuous  except  possibly  at  a  finite  number  of  points 
on  any  finite  interval  and  with  finite  left-  and  right-hand  limits  at  these  points.)  The  family  of 
norms  is  given  by  the  L2  norm  \\f\\st  =  f*  |/(r)|2dr,  f  £  £(3t,3t).  The  (usually  input)  space  U 
is  either  the  bounding  space  A  for  this  family  or  a  shift-invariant  subset  thereof.  Define  u  and 
d  by 

0,  t  <  —  1;  t  >  11 

t  + 1,  -l<t<0 

1,  0<t<10 

-t  +  11,  10  <  i  <  11 

'0,  t<- 1 

1,  -l<t<0 

d(t)  =  <  0,  0  <  t  <  10 

-1,  10<f<ll 
,0,  11  <  t 

We  observe  that  u  and  d  are  in  L-2 ■  We  note  that  u  is  not  differentiable;  however,  we  show 
below  that  u  is  shift  differentiable.  We  have  that  ( with  0  <  h  <  10) 

'0,  t<-l-h 

t  (1  hf) ,  — 1  —  h  <  t  <  — h 

L hU  (t)  =  <  1,  —  h  <  t  <  10  —  h 

-t  + (11-/0,  10  -h<t<  11- h 
0,  11  —  h  <  t 

Then  we  calculate 

°, 

t  +  (1  +  h)  , 

0, 

—  (t  +  h), 

(L h.u  —  u  —  h  ■  d)  (t)  =  0, 

—t  +  (10  —  h ) , 

0, 

t-(ll-h), 

.  0, 

Noting  that  e  =  (L h.u  —  u  —  h  ■  d).  We  first  calculate 

fO  a  .  ;,3 

||L hU  —  u  —  h  ■  d\\ 2  =  2  •  2  •  /  t2dt  =  — - — 

J-h  3 


t<-l-h 

-l-h<t<-l 

—h  <  t  <  0 
0  <  t  <  10  -  h 

10  -  h  <  t  <  10 
10<t<ll-h 
ll-h<t<ll 

11  <  t 
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then 


lim 

h->  o 


\e(h)\\ 


lim 

h^O 


=  —=  lim 
V3  h^O 


h3'2 

h 


=  0 


Example  C-4  Let  the  basic  function  space  £(K,  K)  for  inputs  be  the  set  of  real-valued  functions 
on  SR  that  are  bounded  and  piecewise  continuous  ( continuous  except  possibly  at  a  finite  number 
of  points  on  any  finite  interval  and  with  finite  left-  and  right-hand  limits  at  these  points).  The 
family  of  norms  is  given  by  L\  norm  ||/||st  =  f*  |/(r)|dr,  /  £  £(R,R).  The  (usual  input)  space 
U  is  either  the  bounding  space  A  for  this  family  or  a  shift-invariant  subset  thereof.  This  time 
let  u  be  the  boxcar  step  and  d  be  the  addition  of  delta  functions,  respectively , 


f  1,  0<t<10 
\  0,  elsewhere 


5(t)  = 


0,  t  +  0 

undefined,  t  =  0 


with 


/  5  (t)  dr  =  1  . 

J  —  OO 

(The  usual  symbol  for  the  delta  function  is  6.) 

d(t)  =  5  ( t )  —  5  (t  —  10) 


We  note  that  u  is  not  continuous;  however,  we  show  below  that  u  is  shift  differentiable, 
have  that  (with  h>  0) 


L hu  C t ) 


1,  —h  <  t  <  10  —  h 
0,  elsewhere 


tEe 


Then  we  calcidate  e 


(L/jit  —  u  —  h  ■  d).  First  define  g  by 


[ g  0)]  (■ t )  =  ( Lhu  -  u)  (t) 


0,  t  <  —h 

1,  -h  <  t  <  0 

<  0,  0<t<10-/i 

-1,  10 -h<t<  10 
,0,  10  <  t 


Then 

[e  (h)]  (■ t )  =  [g  (h)}  ( t )  -  hd  (t)  =  [g  (h)]  (t)  -  hS  (t)  +  hS  (t  -  10)  . 
Looking  at  the  essential  property  e  must  have, 


urn  ■'I'Wiwn  =  lim 


h—y  0 


h—y  0 
-10 


\[e(h)]  (r)| 
h 


dr 


|  I'  /■()  /•  1 1 )  POO  'j 

lim  —  <  1  ■  dr  —  1  ■  dr  —  h  ■  d(r)  dr\ 

h^oh[J_h  J10_h  J J 
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i  C  rO  r  oo  ^  i  C  rlO  roo 

lim  —  <  /  1  •  dr  —  h  ■  /  5  (r)  dr  >  —  lim  —  <  /  1  ■  dr  —  h  ■  5  (r  —  10)  dr 

fc-O/lU-A  7-oo  J  h^0h[Jw_h  J-oo 


=  2  •  lim 

/i^O 


-{d-d} 


=  2  •  lim 
h—>  0 


r° 


=  2  •  lim  [01  =  0 
h-^  0 


The  next  proposition  gives  sufficient  conditions  for  shift  differentiability. 

Proposition  C-5  Let  C  =  £(5i,  E)  be  a  linear  space  of  time  functions.  Use  the  Lp  norm.  For 
f  G  C,  let  f  (■ t )  be  the  derivative,  that  is, 


f  (t)  =  lim 

v  h->  o 


f(t  +  h)-f  ( t ) 
h 


(C-5) 


/or  all  t  €  dt.  Define 


e{t,h)  =  f  (t  +  h)  -  f  ( t )  -  hf  ( t ) 

/or  all  t,  h  G  K.  Assume  e  (t,  ■)  is  measurable.  Assume  there  exists  e  (t)  6  L\  (— oo,  T\  such  that. 

I  e  (C  ^  ) 


h 


<  e  (t) 


for  all  t,  h  T/ien 


L hf  (t)  =  f  (t  +  h)  =  f  (t)  +  h/'  (t)  +  e  (t,  /t) 


(C-6) 


(C-7) 


with 


lim 


—  =  lim  - 
h— >0  h  h->0  h 


\e  (t,  h)\\p  dt  =  lim 
/?. — >o 


l[T 

e  ( t ,  h) 

I  J  —oo 

h 

dt 


using  (C-6)  and  the  Lebesgue  Dominated  Convergence  Theorem, 


\  f  Hm 

V  7-00 


e  ( t ,  h ) 


h 


dt  = 


e  (t,  /i) 


lim 

/i->o  h 


p 


dt  =  0  . 


So,  f  is  the  shift  derivative  of  f.  If  the  limit  in  (C-5)  and  the  bound  in  (C-6)  are  almost 
everywhere,  then  the  result  is  in  terms  of  the  eqivalence  classes  u  6  U, 


L hu  =  u  +  hd  +  e  (h)  . 
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In  this  appendix,  sufficient  conditions  for  a  system  trajectory  to  be  shift-differentiable  are 
considered.  That  the  system  be  time-invariant  is  a  straightforward  sufficient  condition.  For 
time- varying  systems,  our  conditions  are  based  on  a  hypothesis  SG,  defined  below,  and  the 
semigroup  it  defines  being  strongly  continuous.  NSWCDD’s  publications  format  guide  requires 
that  appendices  be  self-contained,  so  we  recover  here  several  definitions  from  the  main  text  of 
this  report. 

An  input-output  system  is  denoted  ( Y,F,U ),  where  F  is  a  mapping  from  an  input  space 
U  to  an  output  space  Y .  and  where  U  and  Y  are  translation-invariant  spaces  of  vector- valued 
time  functions.  The  input  and  output  space  metrics  are  set  up  by  senrinornrs  referred  to  as 
fitted  families  (FFs)  of  senrinornrs.  The  notation  ||uSjt||  .  indicates  the  norm  of  the  input  u  over 
the  interval  of  time  (s,  t].  Us,t  is  the  space  of  inputs  over  the  same  interval.  FFs  were  initially 
described  in  [D-l]. 

Definition  D-l  [D-l]  Let  C  =  C(JR,  E)  be  a  linear  space  of  time  functions  from  3ft  into  a 
Banach  space  E  such  that  any  translate  of  a  function  in  C  is  also  a  function  in  C.  Let  M  = 
{||-||s  t ,  — oo  <  s  <  t  <  00}  be  a  family  of  seminorms  on  C  satisfying  the  following  conditions: 

(1)  For  /r,  /2  €  C,  if  /r(r)  =  /2(r)  for  s  <t  <t  then  ||/r  -  f2\\s>t  =  0. 

(2)  Let  Lr  denote  shift  to  the  left  by  r.  For  all  f  G  C,  ||Lr/||s_r  t_T  =  ||/||st. 

(3)  Let  r  <  s  <t.  Then  for  all  f  6  C,  ||/||S)t  <  \\f\\r>t. 

(4)  Let  r  <  s  <  t.  Then  for  all  f  G  C,  j|/j|r|t  <  ||/||r>s  +  ||/||s,r 

(5)  There  exists  0  <  a  <  00  and  K  >  1  such  that  if  0  <  t  —  r  <  a  and  r  <  s  <  t,  then  for 
all  fe£,  ||/||ria<jq/||r)t. 

The  pair  (£,M)  is  called  a  FF  of  seminorms  on  C.  The  normed  linear  space  formed  from 
equivalence  classes  of  functions  in  C  with  norm  ||-||5t  is  denoted  AS}t.  The  elements  of  AS}t  are 
the  equivalence  classes  determined  by:  f  g,  f,g  G  £  if  and  only  if  \\f  -  g\\st  =  0.  They  are 
denoted  uSjt,  ys,t>  etc.  The  set  {ASjt},  —00  <  s  <  t  <  00,  is  the  FF  of  normed  linear  spaces 
given  by  (C,A f). 

We  also  define  IML^  =  lim^-oo  ||«||a>t  =  ||u||t.  Also,  ||/||S)00  =  supt>s  ||/||st,  and  ||/||  = 
supt  ||/||t  .  A  mapping  F  :U  —>Y  is  called  a  global  input-output  mapping. 

Definition  D-2  Let  (Y,  F,  U )  be  an  input-output,  system.  F  is  a  causal  mapping  and  (Y,  F,  U ) 
is  a  causal  system  if  and  only  if  for  all  t  and  for  all  u,v  £  U  such  that  ||tt  —  v\\t  =  0;  it  follows 
that  H-F(u)  —  F(v) ||t  =  0. 


If  F  satisfies  this  definition,  it  determines  a  mapping  from  Ut  into  Bt,  denoted  Ft,  that 
satisfies  Ftut  —  ( Fu)t  =  0.  We  call  Ft  a  truncated  input-output,  mapping,  and  define  the 

centered  truncated  input-output,  mapping  Ft  :  Uo  —■ ►  To  by  Ft(uo)  =  LtFtRtfuo),  where  Rf  =  L 
is  the  right-shift  by  t.  The  norms  we  use  here  for  input-output  mappings  F ,  Ft,  and  Ft  are  the 
IV-power  norms,  denoted  [  •  |. 

Let  T  be  a  mapping  from  a  nornred  linear  space  X  into  a  nornred  linear  space  Y .  For  any 
nonnegative  integer  N,  the  IV-power  norm  for  is  given  by 


wAsupJffiiJi 

xex  1  +  x 


(D-l) 
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when  the  right  side  exists.  We  say  is  bounded  (in  N— power  norm)  if  [<£>|  <  oo.  Let  Fn(X,  Y) 
be  the  normed  linear  space  of  all  mappings  $  :  X  — >  Y  with  [<J>|  <  oo,  and  Cn(X,  Y)  be  the 
norrned  linear  subspace  of  Xn(X,  Y)  of  all  continuous  d>. 

Definition  D-3  A  system  trajectory  is  a  shift  differentiable  system  trajectory  t  — >  Ft  if 


LhFRh  =  F  +  h  ■  G  +  H(h) 


(D-2) 


where  G  £  Cn(U,Y)  and  H(h)  £  Cn(U,Y )  and  such  that. 

lim  S  =  o  for  all  t  £  9ft-  (D-3) 

h->o  h  y  ’ 

We  define  the  truncation  mapping  7rt  on  the  space  of  systems  Cn(X,  Y)  by  irtF  =  Ft. 

Definition  D-4  We  say  F  =  {(Y,  F,  U)}  satisfies  condition  (SG)  if  for  all  F1,  F2  £  F,  irtF1  = 
7 tsF2  for  some  t,  s  £  Sfi  implies  tt t+aF1  =  irs+aF2  for  all  a  >  0. 

Now,  define  an  operator  6  (s,t)  for  s,  t  £  K,  s  <  t,  with  domain  F.s  and  counter-domain  F* 

by 

8(s,t)Fs  =  TTtOTT^Fs  . 

If  condition  (SG)  is  satisfied,  9  (s,  t )  is  a  well-defined  operator  that  is  linear  on  its  domain. 
In  fact,  9  only  depends  on  (t  —  s).  The  family  of  operators  {8  (r) ;  r  >  0}  is  a  one-parameter 
semigroup  of  operators,  linear  on  the  domain  specified. 


Lemma  D-5  [D-2,  Lemma  5.5.1]  Let  F  =  {(Y,  F,U)}  be  as  described  in  the  preceding  para¬ 
graph.  Let  {9  (r) ,  r  >  0}  be  the  semigroup  defined  by  condition  (SG).  Assume  that  {9  (r) ,  r  >  0} 
is  a  strongly  continuous  semigroup  of  bounded  linear  transformations  with  infinitesimal  gener¬ 
ator  A.  For  F  £  F,  if  Ft  £  Domain  (A)  for  all  t  and 


lim 

h->  o 


8  (h)  Ft  -  Ft 
h 


AFt  =  0 


(D-4) 


uniformly  in  t,  then  the  system  trajectory  t  — >  Ft  is  shift  differentiable. 


Proof:  Consider  the  system  trajectory  t  — >  Ft  of  the  input-output  system  ( Y,F,U ).  Fix 
h  >  0  and  consider  the  time  function  t  — >  9  ( h )  Ft  or  t  —>  Ft+h,  which  is  a  time  function  in 
£(3i,  Cn  (Uq,Yq)).  The  time  function  t  —>  Ft+h  is  actually  defined  by  the  causal  input-output 
system  (Y,  L^LR/j,  U).  By  the  uniform  convergence  in  (D-4),  the  sequence 

l  (V«) 

is  Cauchy  in  the  metric  of  Cn(X,Y).  Let  this  sequence  converge  to  G  £  Cn(X,Y).  (The 
completeness  of  Cn(X,Y )  is  considered  in  Lemma  A.l  of  [D-2].)  Note  that  for  all  t  £  3ft, 
A  -  Ft  =  Gt ■  For  each  h  £  K,  define  Ft  (h)  £  Cn  (Uq,  Yq)  by 


}+oo 

n= 1 


H  (h)  =  LhFRh  -F-hG 
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It  is  seen  that  liiri/wo  H  (h)  /h  =  0;  therefore,  the  system  trajectory  t  —>  Ft  is  shift  differentiable. 

□ 

Lemma  D-5  gives  (D-3)  is  uniform  in  t. 
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